Four-Factor Integrity Breakdown & Primary-Source Evidence
Access Model: Auto-Gated / Encrypted
"contains the data files, and is password-proteced with this password: deserted-untie-orchid"
"You need to agree to share your Hugging Face information to access this dataset This repository is publicly accessible, but you have to accept the conditions to access its files and content"
Originality
Weight 25%
10/10
Reuse Profile: All Original (0% reuse)
"198 questions covering biology, physics, and chemistry - we test the GPQA Diamond subset of the full GPQA dataset (448 questions total), which was defined by the original authors as the highest quality subset, where both experts answer correctly and the majority of non-experts answer incorrectly"
Freshness
Weight 20%
0/10
Initial Release: 2023-11Latest Refresh: 2023-11Rolling Updates: No
"arXiv:2311.12022 (cs) [Submitted on 20 Nov 2023]"
Grading
Weight 15%
7.3/10
Integrity: Independent StandardizedSandbox: not applicable single turn
"4 option multiple choice format Regex-based answer extraction with pass@1 scoring (prompt and regex below)"
Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:
[](https://benchaudit.org/benchmarks/gpqa-diamond/)