Gamma-ray bursts don't get kicked around