Neutron stars could be the ultimate dark matter detectors