# Vending-Bench 2 Contamination Audit

> Vending-Bench 2 scores 9/10 (Tier S, Fortified) on BenchAudit as of November 2026, reflecting a strictly private held-out test set and self-reported or live-network evaluation.

- **Canonical URL:** https://benchaudit.org/benchmarks/vending-bench-2/
- **Benchmark ID:** `vending-bench-2`
- **Hub:** Andon Labs
- **Category:** Knowledge Work
- **Domains:** Business, Finance
- **Skills:** Agentic, Tool Use, Reasoning, Long Context, Knowledge Work
- **BenchAudit Score:** 9/10 (Tier S - Fortified)
- **Last Audited:** 2026-11-19 (Ref 2026-11)

## Factor Scores

| Factor | Score (/10) | Weight |
| --- | ---: | ---: |
| Privacy | 10 | 40% |
| Originality | 10 | 25% |
| Freshness | 10 | 20% |
| Grading | 3.3 | 15% |

## Primary-Source Evidence

### Privacy
> "We're releasing Vending-Bench 2, a benchmark for measuring AI model performance on running a business over long time horizons. Models are tasked with running a simulated vending machine business over a year and scored on their bank account balance at the end."
- Source: https://andonlabs.com/evals/vending-bench-2

### Originality
> "Vending-Bench 2 keeps the core idea from Vending-Bench of managing a business in a lifelike setting, but introduces more real-world messiness inspired by learnings from our vending machine deployments:"
- Source: https://andonlabs.com/evals/vending-bench-2

### Freshness
> "Vending-Bench 2 released November 18, 2025 Vending-Bench is now deprecated in favor of our new benchmark for agentic long-term coherence, creatively named Vending-Bench 2."
- Source: https://andonlabs.com/evals/vending-bench

### Grading
> "Models can search the internet to find suitable suppliers and then contact them through e-mail to make orders."
- Source: https://andonlabs.com/evals/vending-bench-2
