True Index: Domain Rankings
Agentic & Enterprise1.0p
#44
2 Top-Tier private testsCoding & SWE3.2p
#44
2 Top-Tier private testsMath & Scientific Reasoning14.6p
#41
2 Top-Tier private testsHead-to-Head: Clean Evals vs. Legacy Benchmarks
| Capability Domain | Clean Evals (Tiers S & A) | Legacy Benchmarks (Tiers C & D) | Public Lift (Boost) |
|---|---|---|---|
| Agentic & Enterprise | 1.0p | 1.0p | +0.0p |
| Coding & SWE | 3.2p | 11.7p | +8.4p |
| Math & Scientific Reasoning | 14.6p | 5.7p | -8.9p |
Clean Evals Avg (Tiers S & A)
10.4p
7 private, leak-resistant tests
Legacy Benchmarks Avg (Tiers C & D)
6.1p
5 public or aging tests
Matched Public Lift (Boost)
-1.2p
Near zero or negative indicates clean generalization
Machine-Readable Export
Audited Benchmark Performance of Nemotron 3.5 Super VL
Grouped by benchmark integrity so private capability signal stands apart from aging public tests.
Top-Tier Validated Tests (Tiers S & A) (7)
Private, leak-resistant tests that build real capability signal.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| MLCR-AA | Private / Fresh | Math & Scientific Reasoning | #39/46 | 21.0p |
| FrontierCode-AA 2.0 | Private / Fresh | Coding & SWE | #45/46 | 2.9p |
| AA-Briefcase v1.1 | Private / Fresh | Agentic & Enterprise | #49/50 | 2.0p |
| AutomationBench-AA | Private / Fresh | Agentic & Enterprise | #50/50 | 0.0p |
| AA-Omniscience v1.1 | Private / Fresh | General Knowledge & QA | #37/47 | 22.9p |
| CritPt v2 | Private / Fresh | Math & Scientific Reasoning | #36/40 | 8.2p |
| Code Migration v1.1 | Private / Fresh | Coding & SWE | #24/24 | 3.6p |
Mid-Tier Evaluations (Tier B) (1)
Partially exposed or transitional evaluations with moderate leakage risk.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| HLE-Diamond | Semi-Exposed | General Knowledge & QA | #49/49 | 0.0p |
Legacy & Vulnerable Benchmarks (Tiers C & D) (5)
Public or aging benchmarks prone to overfitting and training-data leaks.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| SWE Atlas - Codebase QnA | Public / Aging | Coding & SWE | #15/15 | 22.4p |
| Terminal-Bench-Science 0.1 | Public / Aging | Math & Scientific Reasoning | #40/41 | 5.7p |
| GDP.pdf | Public / Aging | Agentic & Enterprise | #49/50 | 2.0p |
| Terminal-Bench 4.0 | Public / Aging | Coding & SWE | #49/50 | 1.0p |
| GDPval-AA v2.1 | Public / Aging | Agentic & Enterprise | #43/43 | 0.0p |