Domains: Medical
Skills: Long ContextReasoningKnowledge WorkWriting

Four-Factor Integrity Breakdown & Primary-Source Evidence

Privacy

Weight 40%
10/10
Access Model: Strictly Private
"Artificial Analysis evaluates a private held-out set of the two hardest tiers (expert-tier clinical synthesis and compound, multi-part reasoning): 60 questions, each run with 3 repeats. This private set is separate from the publicly released dataset"

Originality

Weight 25%
10/10
Reuse Profile: All Original (0% reuse)
"Each case is a realistic synthetic medical record of roughly 25,000 to 64,000 tokens. Unless a question sets its own format, we ask models to answer each part in one paragraph and cite the supporting evidence from the record."

Freshness

Weight 20%
10/10
Initial Release: 2026-06Latest Refresh: 2026-08Rolling Updates: No
"[2026/08/31] We are excited to release MLCR v1.1 that comes with some improvements to judging calibration and a release with Artificial Analysis"
Primary source (GitHub) ↗ Verified 2026-11-17

Grading

Weight 15%
10/10
Integrity: Independent Offline (Leak-Verified)Sandbox: not applicable single turn
"Responses are scored by a panel of three LLM judges (Claude Opus 5.5, GPT-6.1 Sol, and Grok 4.7, each at medium reasoning effort) against expert-annotated ground truth and the source medical record."

Frontier Model Standings on MLCR-AA

Top 15 active models tracked
Rank Model Official Score Percentile
#1Claude Fable 5.2 max Anthropic43.9%100.0p
#2Claude Sonnet 5.5 max Anthropic41.7%97.6p
#2GPT-6 Astra max OpenAI41.7%97.6p
#4GPT-6.2 Astra max OpenAI39.4%94.4p
#5GPT-6.1 Sol max OpenAI38.3%91.3p
#5Kimi K3.1 Pro max Kimi38.3%91.3p
#7GPT-6.2 Sol max OpenAI37.2%88.2p
#8Claude Haiku 5.5 max Anthropic35.0%86.0p
#9GPT-6 Sol max OpenAI33.9%83.9p
#10Tencent Hy4 default Tencent32.8%81.8p
#11Gemini 4 Neon xhigh Google31.7%79.8p
#12GPT-6.1 Terra max OpenAI30.6%76.6p
#14Claude Opus 5.5 max Anthropic27.8%73.4p
#15DeepSeek V4.1 Flash 1017 max DeepSeek26.7%71.4p
#16GPT-6 Luna max OpenAI26.1%69.3p

Embeddable Audit Badge

View Markdown (.md)

Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:

BenchAudit MLCR-AA Tier S 10/10
[![BenchAudit Tier S](https://benchaudit.org/badges/mlcr-aa.svg)](https://benchaudit.org/benchmarks/mlcr-aa/)