# ITBench-AA Contamination Audit

> ITBench-AA scores 8.8/10 (Tier S, Fortified) on BenchAudit as of November 2026, reflecting a hybrid public and private held-out split and isolated offline third-party grading.

- **Canonical URL:** https://benchaudit.org/benchmarks/itbench-aa/
- **Benchmark ID:** `itbench-aa`
- **Hub:** Artificial Analysis / IBM
- **Category:** Coding
- **Domains:** Coding, Cyber
- **Skills:** Coding, Agentic, Tool Use, Reasoning, Long Context
- **BenchAudit Score:** 8.8/10 (Tier S - Fortified)
- **Last Audited:** 2026-11-17 (Ref 2026-11)

## Factor Scores

| Factor | Score (/10) | Weight |
| --- | ---: | ---: |
| Privacy | 7.5 | 40% |
| Originality | 10 | 25% |
| Freshness | 9 | 20% |
| Grading | 10 | 15% |

## Primary-Source Evidence

### Privacy
> "We evaluate 59 Kubernetes incident tasks: 40 from IBM's public ITBench SRE release and 19 private tasks shared with us by the ITBench team."
- Source: https://artificialanalysis.ai/methodology/intelligence-benchmarking

### Originality
> "ITBench-AA is Artificial Analysis' independent implementation of IBM's ITBench benchmark, evaluating AI agents on Site Reliability Engineering (SRE): Kubernetes incident root-cause analysis."
- Source: https://artificialanalysis.ai/evaluations/itbench-aa

### Freshness
> "arXiv:2502.05352 (cs) [Submitted on 7 Feb 2025] Title: ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks"
- Source: https://arxiv.org/abs/2502.05352

### Grading
> "Each task is an offline Kubernetes incident snapshot containing alerts, events, traces, metrics, logs, and application topology, baked into a scenario-specific sandbox and mounted under /home/user"
- Source: https://artificialanalysis.ai/methodology/intelligence-benchmarking
