Domains: BusinessFinance
Skills: AgenticTool UseReasoningLong ContextKnowledge Work

Four-Factor Integrity Breakdown & Primary-Source Evidence

Privacy

Weight 40%
10/10
Access Model: Strictly Private
"We're releasing Vending-Bench 2, a benchmark for measuring AI model performance on running a business over long time horizons. Models are tasked with running a simulated vending machine business over a year and scored on their bank account balance at the end."

Originality

Weight 25%
10/10
Reuse Profile: All Original (0% reuse)
"Vending-Bench 2 keeps the core idea from Vending-Bench of managing a business in a lifelike setting, but introduces more real-world messiness inspired by learnings from our vending machine deployments:"

Freshness

Weight 20%
10/10
Initial Release: 2025-11Latest Refresh: 2025-11Rolling Updates: No
"Vending-Bench 2 released November 18, 2025 Vending-Bench is now deprecated in favor of our new benchmark for agentic long-term coherence, creatively named Vending-Bench 2."

Grading

Weight 15%
3.3/10
Integrity: Self-Reported / Live NetworkSandbox: live internet
"Models can search the internet to find suitable suppliers and then contact them through e-mail to make orders."

Embeddable Audit Badge

View Markdown (.md)

Benchmark maintainers can embed this live SVG badge in GitHub READMEs or documentation:

BenchAudit Vending-Bench 2 Tier S 9/10
[![BenchAudit Tier S](https://benchaudit.org/badges/vending-bench-2.svg)](https://benchaudit.org/benchmarks/vending-bench-2/)