Four-Factor Integrity Breakdown & Primary-Source Evidence
Access Model: Public Plaintext
"Codebase QnA consists of 124 tasks that targets the upstream capability of Software Engineering - deep code comprehension that precedes any code change."
"Artificial Analysis's SWE-Atlas-QnA-AA dataset provided wording for several updated Codebase QnA rubric criteria, and Inductive ML's reward-hacking feedback further hardened the task environments."
Originality
Weight 25%
7.2/10
Reuse Profile: Low Reuse (<25%)
"Professional software engineers and technical experts with significant coding and agentic experience write problem statements that require multi-step reasoning across the codebase."
Freshness
Weight 20%
7/10
Initial Release: 2026-05Latest Refresh: 2026-11Rolling Updates: No
"Update November 2026. SWE Atlas v1.1 is live. It combines the three category leaderboards into a single, easy-to-run index covering the same 284 tasks as v1.0."
Integrity: Independent Offline (Leak-Verified)Sandbox: offline isolated
"Agents are instructed to avoid modifying source code files and to clean up any temporary scripts created. A programmatic check automatically fails any task that contains code changes."
Frontier Model Standings on SWE Atlas - Codebase QnA
Top 14 active models tracked
Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:
[](https://benchaudit.org/benchmarks/swe-atlas-qna/)