Domains: CyberCoding
Skills: AgenticCodingTool UseReasoning

Four-Factor Integrity Breakdown & Primary-Source Evidence

Privacy

Weight 40%
10/10
Access Model: Strictly Private
"This dataset remains private at all times, and is the only dataset used for the proprietary benchmark results we publish. It is private to prevent leakage into the training data of foundation models."
"A patch submission is marked as a pass if the edited source tree compiles cleanly, the original PoC no longer triggers the sanitizer error, and hidden holdout checks match the maintainer-fixed reference."

Originality

Weight 25%
0/10
Reuse Profile: High Reuse (>75%)
"Agents are tested on OSS-Fuzz regressions from ARVO images. In cybersecurity, fuzzing is an automated testing technique that feeds many inputs into a program to trigger crashes and memory-safety bugs."

Freshness

Weight 20%
10/10
Initial Release: 2026-09Latest Refresh: 2026-11Rolling Updates: No
"CyberBench v1.1 supersedes v1 because the results were rerun with offline task sandboxes and a hardened clean-room grader. It keeps the 60-task PoC track and publishes a 56-task Patch roster containing the tasks that can be graded reliably under that setup."

Grading

Weight 15%
10/10
Integrity: Independent Offline (Leak-Verified)Sandbox: offline isolated
"CyberBench v1.1 supersedes v1 because the results were rerun with offline task sandboxes and a hardened clean-room grader. It keeps the 60-task PoC track and publishes a 56-task Patch roster containing the tasks that can be graded reliably under that setup."

Frontier Model Standings on CyberBench v1.1

Top 15 active models tracked
Rank Model Official Score Percentile
#1Muse Wonder max Meta80.4%89.6p
#2GPT-6 Sol max OpenAI78.0%86.6p
#3Gemini 4 Argon high Google77.9%83.7p
#4GPT-6 Luna max OpenAI76.2%80.7p
#5Claude Haiku 5.5 max Anthropic75.5%77.7p
#6MiMo-V2.6-Flash default Xiaomi75.4%74.7p
#7DeepSeek V4.1 Flash 1017 max DeepSeek73.7%71.7p
#8Muse Wonder Full max Meta73.6%68.7p
#9MiMo-V2.6-Pro default Xiaomi72.9%64.3p
#11Inkling 2 Small default Thinking Machines72.7%58.3p
#11Muse Spark 1.3 max Meta72.7%58.3p
#13GLM-5.3 max Z AI72.1%53.9p
#14Claude Fable 5.1 max Anthropic70.4%50.9p
#15Grok 4.7 xhigh SpaceXAI69.5%48.0p
#17Qwen3.8 27B xhigh Alibaba67.8%42.0p

Embeddable Audit Badge

View Markdown (.md)

Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:

BenchAudit CyberBench v1.1 Tier A 7.5/10
[![BenchAudit Tier A](https://benchaudit.org/badges/cyberbench.svg)](https://benchaudit.org/benchmarks/cyberbench/)