True Index: Domain Rankings
Agentic & Enterprise16.4p
#40
2 Top-Tier private testsCoding & SWE9.6p
#41
2 Top-Tier private testsMath & Scientific Reasoning22.9p
#39
3 Top-Tier private testsHead-to-Head: Clean Evals vs. Legacy Benchmarks
| Capability Domain | Clean Evals (Tiers S & A) | Legacy Benchmarks (Tiers C & D) | Public Lift (Boost) |
|---|---|---|---|
| Agentic & Enterprise | 16.4p | 24.0p | +7.6p |
| Coding & SWE | 9.6p | 23.5p | +13.9p |
| General Knowledge & QA | 34.1p | 44.0p | +9.9p |
| Math & Scientific Reasoning | 22.9p | 17.1p | -5.8p |
Clean Evals Avg (Tiers S & A)
20.8p
10 private, leak-resistant tests
Legacy Benchmarks Avg (Tiers C & D)
27.1p
6 public or aging tests
Matched Public Lift (Boost)
+6.5p
Near zero or negative indicates clean generalization
Machine-Readable Export
Audited Benchmark Performance of Muse Spark Open
Grouped by benchmark integrity so private capability signal stands apart from aging public tests.
Top-Tier Validated Tests (Tiers S & A) (10)
Private, leak-resistant tests that build real capability signal.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| FrontierMath | Private / Fresh | Math & Scientific Reasoning | #21/27 | 37.8p |
| AutomationBench-AA | Private / Fresh | Agentic & Enterprise | #41/50 | 18.4p |
| AA-Briefcase v1.1 | Private / Fresh | Agentic & Enterprise | #43/50 | 14.3p |
| FrontierCode-AA 2.0 | Private / Fresh | Coding & SWE | #43/46 | 7.5p |
| MLCR-AA | Private / Fresh | Math & Scientific Reasoning | #46/46 | 6.3p |
| AA-Omniscience v1.1 | Private / Fresh | General Knowledge & QA | #18/47 | 64.4p |
| CritPt v2 | Private / Fresh | Math & Scientific Reasoning | #29/40 | 24.7p |
| ARC-AGI-2 | Private / Fresh | General Knowledge & QA | #20/22 | 20.8p |
| LiveBench | Private / Fresh | General Knowledge & QA | #28/28 | 17.2p |
| Code Migration v1.1 | Private / Fresh | Coding & SWE | #22/24 | 11.7p |
Mid-Tier Evaluations (Tier B) (1)
Partially exposed or transitional evaluations with moderate leakage risk.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| HLE-Diamond | Semi-Exposed | General Knowledge & QA | #25/49 | 50.0p |
Legacy & Vulnerable Benchmarks (Tiers C & D) (6)
Public or aging benchmarks prone to overfitting and training-data leaks.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| GDP.pdf | Public / Aging | Agentic & Enterprise | #31/50 | 38.8p |
| SWE-bench Pro V2 | Public / Aging | Coding & SWE | #7/8 | 34.8p |
| Terminal-Bench-Science 0.1 | Public / Aging | Math & Scientific Reasoning | #36/41 | 17.1p |
| Terminal-Bench 4.0 | Public / Aging | Coding & SWE | #44/50 | 12.2p |
| GDPval-AA v2.1 | Public / Aging | Agentic & Enterprise | #38/43 | 9.2p |
| MMMU-Pro | Public / Aging | General Knowledge & QA | #12/22 | 44.0p |