Evals · Part 5Evaluation & Reliability
Benchmark Contamination: Detecting a Model That Has Seen the Test
We leaked ARC questions into a small model's training data on purpose, then tested n-gram checks, Min-K%, shuffled-order tests and black-box probes on it.