True Index: Domain Rankings

Private Top-Tier (S & A) standing across 3 core domains
Agentic & Enterprise1.0p
#44
2 Top-Tier private tests
Coding & SWE3.2p
#44
2 Top-Tier private tests
Math & Scientific Reasoning14.6p
#41
2 Top-Tier private tests

Head-to-Head: Clean Evals vs. Legacy Benchmarks

3 matched domains · positive boost means higher legacy scores
Capability Domain Clean Evals (Tiers S & A) Legacy Benchmarks (Tiers C & D) Public Lift (Boost)
Agentic & Enterprise1.0p (2)1.0p (2)+0.0p
Coding & SWE3.2p (2)11.7p (2)+8.4p
Math & Scientific Reasoning14.6p (2)5.7p (1)-8.9p
Clean Evals Avg (Tiers S & A)
10.4p
7 private, leak-resistant tests
Legacy Benchmarks Avg (Tiers C & D)
6.1p
5 public or aging tests
Matched Public Lift (Boost)
-1.2p
Near zero or negative indicates clean generalization
Machine-Readable Export

Audited Benchmark Performance of Nemotron 3.5 Super VL

Grouped by benchmark integrity so private capability signal stands apart from aging public tests.

Top-Tier Validated Tests (Tiers S & A) (7)

Private, leak-resistant tests that build real capability signal.

BenchmarkBenchmark Integrity StatusDomainRankPercentile
MLCR-AAPrivate / FreshMath & Scientific Reasoning#39/4621.0p
FrontierCode-AA 2.0Private / FreshCoding & SWE#45/462.9p
AA-Briefcase v1.1Private / FreshAgentic & Enterprise#49/502.0p
AutomationBench-AAPrivate / FreshAgentic & Enterprise#50/500.0p
AA-Omniscience v1.1Private / FreshGeneral Knowledge & QA#37/4722.9p
CritPt v2Private / FreshMath & Scientific Reasoning#36/408.2p
Code Migration v1.1Private / FreshCoding & SWE#24/243.6p

Mid-Tier Evaluations (Tier B) (1)

Partially exposed or transitional evaluations with moderate leakage risk.

BenchmarkBenchmark Integrity StatusDomainRankPercentile
HLE-DiamondSemi-ExposedGeneral Knowledge & QA#49/490.0p

Legacy & Vulnerable Benchmarks (Tiers C & D) (5)

Public or aging benchmarks prone to overfitting and training-data leaks.

BenchmarkBenchmark Integrity StatusDomainRankPercentile
SWE Atlas - Codebase QnAPublic / AgingCoding & SWE#15/1522.4p
Terminal-Bench-Science 0.1Public / AgingMath & Scientific Reasoning#40/415.7p
GDP.pdfPublic / AgingAgentic & Enterprise#49/502.0p
Terminal-Bench 4.0Public / AgingCoding & SWE#49/501.0p
GDPval-AA v2.1Public / AgingAgentic & Enterprise#43/430.0p