
Same Probe, Different Numbers: Are Activation Probes Robust to Inference-Time Numerics?
Activation probes are trained under one inference setup and deployed under another. Across three models and 768 probes, we find they barely notice batch-size and precision changes when reading the prompt. During generation, the same rounding noise changes the text the model writes, and that is what flips probe verdicts. Aggregate accuracy hides this by up to 9x.






