Four-Factor Integrity Breakdown & Primary-Source Evidence
Access Model: Strictly Private
"Thus, our proprietary benchmarks are evaluated on private data."
"The grader builds that image and runs a hidden behavior-test suite the model never sees."
Originality
Weight 25%
0/10
Reuse Profile: High Reuse (>75%)
"30 open-source repositories spanning Python, Java, Kotlin, Rust, and C++. Each is migrated into its four non-source target languages (120 scored repository-language migrations in all), and every migration is graded against a hidden suite of roughly 100 to 400 behavior tests, exercised through the program’s command-line interface."
Freshness
Weight 20%
10/10
Initial Release: 2026-09Latest Refresh: 2026-11Rolling Updates: No
"v1.1 runs every model on the Pi agent harness instead of mini-SWE-agent, and grades against revised hidden test suites. The tasks are the same, but scores are not directly comparable to"
Integrity: Independent Offline (Leak-Verified)Sandbox: offline isolated
"The model works in an offline sandbox with the source program and task instructions, and submits a target-language implementation plus a Dockerfile. The grader builds that image and runs a hidden behavior-test suite the model never sees. Before scoring, a separate anti-cheat checker inspects each submission and zeroes any that wrap the original executable, copy reference artifacts, or hardcode expected outputs."
Frontier Model Standings on Code Migration v1.1
Top 15 active models tracked
Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:
[](https://benchaudit.org/benchmarks/code-migration-v1-1/)