True Index: Domain Rankings
Agentic & Enterprise54.2p
#21
4 Top-Tier private testsCoding & SWE47.8p
#28
4 Top-Tier private testsMath & Scientific Reasoning45.0p
#25
3 Top-Tier private testsHead-to-Head: Clean Evals vs. Legacy Benchmarks
| Capability Domain | Clean Evals (Tiers S & A) | Legacy Benchmarks (Tiers C & D) | Public Lift (Boost) |
|---|---|---|---|
| Agentic & Enterprise | 54.2p | 72.8p | +18.6p |
| Coding & SWE | 47.8p | 50.0p | +2.2p |
| Math & Scientific Reasoning | 45.0p | 44.7p | -0.3p |
Clean Evals Avg (Tiers S & A)
49.6p
13 private, leak-resistant tests
Legacy Benchmarks Avg (Tiers C & D)
55.8p
4 public or aging tests
Matched Public Lift (Boost)
+16.2p
Near zero or negative indicates clean generalization
Machine-Readable Export
Audited Benchmark Performance of Muse Spark 1.3
Grouped by benchmark integrity so private capability signal stands apart from aging public tests.
Top-Tier Validated Tests (Tiers S & A) (13)
Private, leak-resistant tests that build real capability signal.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| Harvey LAB-AA v1.1 | Private / Fresh | Agentic & Enterprise | #7/21 | 82.6p |
| AA-Briefcase v1.1 | Private / Fresh | Agentic & Enterprise | #15/50 | 71.4p |
| FrontierMath | Private / Fresh | Math & Scientific Reasoning | #16/27 | 50.4p |
| FrontierCode-AA 2.0 | Private / Fresh | Coding & SWE | #29/46 | 39.1p |
| AutomationBench-AA | Private / Fresh | Agentic & Enterprise | #33/50 | 34.7p |
| Code2Video-AA | Private / Fresh | Coding & SWE | #16/23 | 33.6p |
| MLCR-AA | Private / Fresh | Math & Scientific Reasoning | #37/46 | 24.2p |
| CritPt v2 | Private / Fresh | Math & Scientific Reasoning | #14/40 | 60.3p |
| AA-3D | Private / Fresh | Coding & SWE | #12/22 | 60.1p |
| CyberBench v1.1 | Private / Fresh | Coding & SWE | #11/25 | 58.3p |
| AA-Omniscience v1.1 | Private / Fresh | General Knowledge & QA | #22/47 | 55.7p |
| LiveBench | Private / Fresh | General Knowledge & QA | #19/28 | 47.5p |
| AA-AnalystAgent | Private / Fresh | Agentic & Enterprise | #20/24 | 28.0p |
Mid-Tier Evaluations (Tier B) (1)
Partially exposed or transitional evaluations with moderate leakage risk.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| HLE-Diamond | Semi-Exposed | General Knowledge & QA | #19/49 | 62.5p |
Legacy & Vulnerable Benchmarks (Tiers C & D) (4)
Public or aging benchmarks prone to overfitting and training-data leaks.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| GDP.pdf | Public / Aging | Agentic & Enterprise | #12/50 | 77.6p |
| GDPval-AA v2.1 | Public / Aging | Agentic & Enterprise | #13/43 | 67.9p |
| Terminal-Bench 4.0 | Public / Aging | Coding & SWE | #25/50 | 50.0p |
| Terminal-Bench-Science 0.1 | Public / Aging | Math & Scientific Reasoning | #25/41 | 44.7p |