Head-to-Head: Clean Evals vs. Legacy Benchmarks

3 matched domains · positive boost means higher legacy scores
Capability Domain Clean Evals (Tiers S & A) Legacy Benchmarks (Tiers C & D) Public Lift (Boost)
Agentic & Enterprise46.3p (3)17.0p (2)-29.3p
Coding & SWE45.1p (3)24.5p (1)-20.6p
Math & Scientific Reasoning30.6p (2)53.1p (1)+22.5p
Non-comparable pre-release tests omitted from audited scoring (model released 2026-08-13): Terminal-Bench-Science 0.1 (2026-08-27).
Clean Evals Avg (Tiers S & A)
36.0p
10 private, leak-resistant tests
Legacy Benchmarks Avg (Tiers C & D)
31.5p
4 public or aging tests
Matched Public Lift (Boost)
-9.2p
Near zero or negative indicates clean generalization
Machine-Readable Export

Audited Benchmark Performance of DeepSeek V4 Pro 0813

Grouped by benchmark integrity so private capability signal stands apart from aging public tests.

Top-Tier Validated Tests (Tiers S & A) (10)

Private, leak-resistant tests that build real capability signal.

BenchmarkBenchmark Integrity StatusDomainRankPercentile
EnterpriseOps-Gym-AAPrivate / FreshAgentic & Enterprise#1/13100.0p
AutomationBench-AAPrivate / FreshAgentic & Enterprise#36/5028.6p
FrontierCode-AA 2.0Private / FreshCoding & SWE#36/4623.4p
FrontierMathPrivate / FreshMath & Scientific Reasoning#24/2722.8p
AA-Briefcase v1.1Private / FreshAgentic & Enterprise#45/5010.2p
CyberBench v1.1Private / FreshCoding & SWE#9/2568.2p
Code Migration v1.1Private / FreshCoding & SWE#14/2443.8p
CritPt v2Private / FreshMath & Scientific Reasoning#25/4038.5p
ARC-AGI-2Private / FreshGeneral Knowledge & QA#18/2228.2p
AA-Omniscience v1.1Private / FreshGeneral Knowledge & QA#40/4715.3p

Mid-Tier Evaluations (Tier B) (1)

Partially exposed or transitional evaluations with moderate leakage risk.

BenchmarkBenchmark Integrity StatusDomainRankPercentile
HLE-DiamondSemi-ExposedGeneral Knowledge & QA#35/4929.2p

Legacy & Vulnerable Benchmarks (Tiers C & D) (4)

Public or aging benchmarks prone to overfitting and training-data leaks.

BenchmarkBenchmark Integrity StatusDomainRankPercentile
GPQA DiamondPublic / AgingMath & Scientific Reasoning#8/1753.1p
Terminal-Bench 4.0Public / AgingCoding & SWE#38/5024.5p
GDPval-AA v2.1Public / AgingAgentic & Enterprise#33/4323.8p
GDP.pdfPublic / AgingAgentic & Enterprise#45/5010.2p