True Index: Domain Rankings
Agentic & Enterprise60.2p
#18
2 Top-Tier private testsCoding & SWE59.4p
#19
1 Top-Tier private testMath & Scientific Reasoning43.0p
#29
1 Top-Tier private testHead-to-Head: Clean Evals vs. Legacy Benchmarks
| Capability Domain | Clean Evals (Tiers S & A) | Legacy Benchmarks (Tiers C & D) | Public Lift (Boost) |
|---|---|---|---|
| Agentic & Enterprise | 60.2p | 57.1p | -3.1p |
| Coding & SWE | 59.4p | 61.2p | +1.8p |
| Math & Scientific Reasoning | 43.0p | 58.6p | +15.6p |
Clean Evals Avg (Tiers S & A)
50.8p
5 private, leak-resistant tests
Legacy Benchmarks Avg (Tiers C & D)
59.0p
3 public or aging tests
Matched Public Lift (Boost)
+4.9p
Near zero or negative indicates clean generalization
Machine-Readable Export
Audited Benchmark Performance of Muse Ember
Grouped by benchmark integrity so private capability signal stands apart from aging public tests.
Top-Tier Validated Tests (Tiers S & A) (5)
Private, leak-resistant tests that build real capability signal.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| AutomationBench-AA | Private / Fresh | Agentic & Enterprise | #17/50 | 67.3p |
| FrontierCode-AA 2.0 | Private / Fresh | Coding & SWE | #20/46 | 59.4p |
| AA-Briefcase v1.1 | Private / Fresh | Agentic & Enterprise | #24/50 | 53.1p |
| MLCR-AA | Private / Fresh | Math & Scientific Reasoning | #28/46 | 43.0p |
| AA-Omniscience v1.1 | Private / Fresh | General Knowledge & QA | #29/47 | 40.4p |
Mid-Tier Evaluations (Tier B) (1)
Partially exposed or transitional evaluations with moderate leakage risk.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| HLE-Diamond | Semi-Exposed | General Knowledge & QA | #27/49 | 45.8p |
Legacy & Vulnerable Benchmarks (Tiers C & D) (3)
Public or aging benchmarks prone to overfitting and training-data leaks.
| Benchmark | Benchmark Integrity Status | Domain | Rank | Percentile |
|---|---|---|---|---|
| Terminal-Bench 4.0 | Public / Aging | Coding & SWE | #20/50 | 61.2p |
| Terminal-Bench-Science 0.1 | Public / Aging | Math & Scientific Reasoning | #19/41 | 58.6p |
| GDP.pdf | Public / Aging | Agentic & Enterprise | #21/50 | 57.1p |