Four-Factor Integrity Breakdown & Primary-Source Evidence
Privacy
Weight 40%
7.5/10
Access Model: Hybrid Public / Private
"The full v1.1 dataset has 3,000 questions in 6 domains. AA-Omniscience-Public v1.1 is a 10% subset of it, split across domains in the same proportions:"
"We keep the other 2,700 questions private to protect the integrity of the evaluation."
Originality
Weight 25%
7.2/10
Reuse Profile: Low Reuse (<25%)
"Questions are derived from authoritative academic and industry sources and generated automatically using an LLM-based question generation agent to ensure unambiguity, scalability, and factual precision."
Freshness
Weight 20%
10/10
Initial Release: 2025-11Latest Refresh: 2026-10Rolling Updates: No
"October 2026 to November 2026 Added HLE-Diamond (10%) to the General category Added Terminal-Bench-Science (15%) to the Science category Added FrontierCode-AA 2.0 (15%) to the Coding category Reduced the GDP.pdf weight from 10% to 5% Replaced CritPt with CritPt v2 (Hard Subset), keeping its 10% weight Removed GDPval-AA from the Intelligence Index Removed SciCode from the Intelligence Index Removed AA-LCR from the Intelligence Index Removed Humanity's Last Exam from the Intelligence Index Upgraded AA-Omniscience to v1.1"
Integrity: Independent Offline (Leak-Verified)Sandbox: not applicable single turn
"Models get no context and no tools, so the evaluation measures what they can recall. Before each question, the model is told to answer only if it is confident, and that abstaining is better than a wrong answer:"
Frontier Model Standings on AA-Omniscience v1.1
Top 15 active models tracked
Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:
[](https://benchaudit.org/benchmarks/aa-omniscience-v1-1/)