Domains: CodingCyber
Skills: CodingAgenticTool UseReasoningLong Context

Four-Factor Integrity Breakdown & Primary-Source Evidence

Privacy

Weight 40%
7.5/10
Access Model: Hybrid Public / Private
"We evaluate 59 Kubernetes incident tasks: 40 from IBM's public ITBench SRE release and 19 private tasks shared with us by the ITBench team."

Originality

Weight 25%
10/10
Reuse Profile: All Original (0% reuse)
"ITBench-AA is Artificial Analysis' independent implementation of IBM's ITBench benchmark, evaluating AI agents on Site Reliability Engineering (SRE): Kubernetes incident root-cause analysis."

Freshness

Weight 20%
9/10
Initial Release: 2025-02Latest Refresh: 2026-05Rolling Updates: No
"arXiv:2502.05352 (cs) [Submitted on 7 Feb 2025] Title: ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks"
Primary source (Paper) ↗ Verified 2026-11-17

Grading

Weight 15%
10/10
Integrity: Independent Offline (Leak-Verified)Sandbox: offline isolated
"Each task is an offline Kubernetes incident snapshot containing alerts, events, traces, metrics, logs, and application topology, baked into a scenario-specific sandbox and mounted under /home/user"

Embeddable Audit Badge

View Markdown (.md)

Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:

BenchAudit ITBench-AA Tier S 8.8/10
[![BenchAudit Tier S](https://benchaudit.org/badges/itbench-aa.svg)](https://benchaudit.org/benchmarks/itbench-aa/)