Domains: Business
Skills: Knowledge WorkAgenticTool UseWritingReasoningLong Context

Four-Factor Integrity Breakdown & Primary-Source Evidence

Privacy

Weight 40%
10/10
Access Model: Strictly Private
"To maintain evaluation integrity, all 91 tasks across the four AA-Briefcase project scenarios are private, including task instructions, project input files and grading rubrics."

Originality

Weight 25%
10/10
Reuse Profile: All Original (0% reuse)
"AA-Briefcase is a new benchmark for testing models on realistic knowledge work tasks in complex projects built by industry experts. Models are evaluated on multi-week knowledge work projects, each with many linked tasks and thousands of input source files."

Freshness

Weight 20%
10/10
Initial Release: 2026-06Latest Refresh: 2026-09Rolling Updates: No
"Version 4.3.2 September 2026 to October 2026 GDPval-AA v2.1: the Elo scale is now anchored to DeepSeek V4.1 Flash (max) at 1600, and ratings are fitted with a Crowd-BT model. AA-Briefcase v1.1: the anchor is unchanged at GPT-5.5 (medium) at 1000, but each pairwise scope is now fitted with a Crowd-BT model."

Grading

Weight 15%
10/10
Integrity: Independent Offline (Leak-Verified)Sandbox: offline isolated
"Model submissions are run with Stirrup in a week-scoped E2B sandbox. Turns: Agents run for up to 500 turns per task. Tools: The agent is given a single code-execution tool that runs shell commands and code inside the sandbox, plus the finish tools below (and a view-image tool when the model supports vision). The sandbox has no internet access, so the agent can only use the provided source files."

Frontier Model Standings on AA-Briefcase v1.1

Top 15 active models tracked
Rank Model Official Score Percentile
#1Claude Sonnet 5.5 max Anthropic1813 Elo100.0p
#2Claude Opus 5.5 max Anthropic1797 Elo98.0p
#3Claude Fable 5.2 max Anthropic1783 Elo95.9p
#4Muse Wonder Full max Meta1729 Elo93.9p
#5Gemini 4 Neon xhigh Google1699 Elo91.8p
#6Qwen4 Max xhigh Alibaba1686 Elo89.8p
#7Kimi K3.1 Pro max Kimi1674 Elo87.8p
#8Claude Fable 5.1 max Anthropic1670 Elo85.7p
#9Muse Wonder max Meta1659 Elo83.7p
#10GPT-6.2 Astra max OpenAI1643 Elo81.6p
#11Grok 4.7 xhigh SpaceXAI1634 Elo79.6p
#12GPT-6.2 Sol max OpenAI1612 Elo77.6p
#13Gemini 4 Carbon high Google1611 Elo75.5p
#14Qwen3.8 Max (0902) xhigh Alibaba1602 Elo73.5p
#15Muse Spark 1.3 max Meta1581 Elo71.4p

Embeddable Audit Badge

View Markdown (.md)

Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:

BenchAudit AA-Briefcase v1.1 Tier S 10/10
[![BenchAudit Tier S](https://benchaudit.org/badges/aa-briefcase-v1-1.svg)](https://benchaudit.org/benchmarks/aa-briefcase-v1-1/)