True Index: Domain Rankings
Agentic & Enterprise41.4p
#33
4 Top-Tier private testsCoding & SWE59.2p
#20
1 Top-Tier private testMath & Scientific Reasoning44.1p
#28
2 Top-Tier private testsHead-to-Head: Clean Evals vs. Legacy Benchmarks
| Capability Domain | Clean Evals (Tiers S & A) | Legacy Benchmarks (Tiers C & D) | Public Lift (Boost) |
|---|---|---|---|
| Agentic & Enterprise | 41.4p | 27.9p | -13.5p |
| Coding & SWE | 59.2p | 40.8p | -18.4p |
| Math & Scientific Reasoning | 44.1p | 68.9p | +24.8p |
Clean Evals Avg (Tiers S & A)
48.3p
7 private, leak-resistant tests
Legacy Benchmarks Avg (Tiers C & D)
39.0p
6 public or aging tests
Matched Public Lift (Boost)
-6.9p
Near zero or negative indicates clean generalization
Machine-Readable Export
Audited Benchmark Performance of DeepSeek V4.1 Flash
Grouped by benchmark integrity so private capability signal stands apart from aging public tests.
Top-Tier Validated Tests (Tiers S & A) (7)
Private, leak-resistant tests that build real capability signal.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| AutomationBench-AA | Private / Fresh | Agentic & Enterprise | #14/50 | 73.5p |
| MLCR-AA | Private / Fresh | Math & Scientific Reasoning | #17/46 | 67.1p |
| Code2Video-AA | Private / Fresh | Coding & SWE | #9/23 | 59.2p |
| Harvey LAB-AA v1.1 | Private / Fresh | Agentic & Enterprise | #17/21 | 44.8p |
| AA-Briefcase v1.1 | Private / Fresh | Agentic & Enterprise | #37/50 | 26.5p |
| CritPt v2 | Private / Fresh | Math & Scientific Reasoning | #30/40 | 21.2p |
| AA-AnalystAgent | Private / Fresh | Agentic & Enterprise | #22/24 | 20.9p |
Mid-Tier Evaluations (Tier B) (1)
Partially exposed or transitional evaluations with moderate leakage risk.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| HLE-Diamond | Semi-Exposed | General Knowledge & QA | #36/49 | 27.1p |
Legacy & Vulnerable Benchmarks (Tiers C & D) (6)
Public or aging benchmarks prone to overfitting and training-data leaks.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| HealthBench | Public / Aging | Math & Scientific Reasoning | #2/16 | 98.1p |
| Terminal-Bench 4.0 | Public / Aging | Coding & SWE | #30/50 | 40.8p |
| Terminal-Bench-Science 0.1 | Public / Aging | Math & Scientific Reasoning | #27/41 | 39.7p |
| GDPval-AA v2.1 | Public / Aging | Agentic & Enterprise | #26/43 | 37.4p |
| GDP.pdf | Public / Aging | Agentic & Enterprise | #41/50 | 18.4p |
| MMMU-Pro | Public / Aging | General Knowledge & QA | #18/22 | 18.2p |