
Preprint argues physics benchmarks understate frontier models, near saturation
A Sept. 11 preprint by Ali Ansari and colleagues, arXiv 2609.13009, argues leading physics benchmarks substantially understate frontier models on well-posed problems. After expert audits established or corrected reference solutions for CritPt and CMT-Benchmark, the authors conclude leading benchmarks are near saturation.
Published