Four-Factor Integrity Breakdown & Primary-Source Evidence
Privacy
Weight 40%
5.5/10
Access Model: Public Prompts / Private Answers
"To ensure data integrity and prevent leakage, our grading server only accepts complete batches containing responses to all 70 problems. Any submission with missing or unmatched problem IDs will be automatically rejected."
"This dataset is intended only as a test set to evaluate the genuine reasoning ability of LLMs on research-level physics problems."
Originality
Weight 25%
10/10
Reuse Profile: All Original (0% reuse)
"CritPt consists of 71 composite research challenges designed to simulate full-scale research projects at the entry level, which are also decomposed to 190 simpler checkpoint tasks for more fine-grained insights. All problems are newly created by 50+ active physics researchers based on their own research."
Freshness
Weight 20%
9/10
Initial Release: 2025-09Latest Refresh: 2026-10Rolling Updates: No
"Version 5.0 October 2026 to November 2026 Added HLE-Diamond (10%) to the General category Added Terminal-Bench-Science (15%) to the Science category Added FrontierCode-AA 2.0 (15%) to the Coding category Reduced the GDP.pdf weight from 10% to 5% Replaced CritPt with CritPt v2 (Hard Subset), keeping its 10% weight"
Integrity: Independent Offline (Leak-Verified)Sandbox: offline isolated
"CritPt v2 is the revised version of CritPt, a benchmark designed to test LLMs on research-level physics reasoning tasks, featuring 70 composite research challenges. Models solve problems with a code-execution tool in an offline Linux sandbox."
Frontier Model Standings on CritPt v2
Top 15 active models tracked
Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:
[](https://benchaudit.org/benchmarks/critpt-v2/)