Four-Factor Integrity Breakdown & Primary-Source Evidence
Privacy
Weight 40%
7.5/10
Access Model: Hybrid Public / Private
"We evaluate 59 Kubernetes incident tasks: 40 from IBM's public ITBench SRE release and 19 private tasks shared with us by the ITBench team."
Originality
Weight 25%
10/10
Reuse Profile: All Original (0% reuse)
"ITBench-AA is Artificial Analysis' independent implementation of IBM's ITBench benchmark, evaluating AI agents on Site Reliability Engineering (SRE): Kubernetes incident root-cause analysis."
Freshness
Weight 20%
9/10
Initial Release: 2025-02Latest Refresh: 2026-05Rolling Updates: No
"arXiv:2502.05352 (cs) [Submitted on 7 Feb 2025] Title: ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks"
Integrity: Independent Offline (Leak-Verified)Sandbox: offline isolated
"Each task is an offline Kubernetes incident snapshot containing alerts, events, traces, metrics, logs, and application topology, baked into a scenario-specific sandbox and mounted under /home/user"
Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:
[](https://benchaudit.org/benchmarks/itbench-aa/)