Benchmarks

Browse Terminal-Bench benchmarks and their tasks.

Terminal-Bench 3

shipped

A benchmark to measure and evolve with the frontier of agent work.

Terminal-Bench 2.1

active

An improved version of Terminal-Bench 2.0, inspired by Z.ai's Terminal-Bench 2.0 Verified.

Terminal-Bench 2.0

active

89 high-quality tasks across software engineering, machine learning, security, data science, and more.

Terminal-Bench 1.0

active

The original Terminal-Bench benchmark. 80 tasks testing agents' abilities to complete tasks using a terminal.

Terminal-Bench Science

in progress

A domain-specific benchmark for scientific computing in terminal environments. Currently in development.

Terminal-Bench Challenges

active

Single-task Terminal-Bench challenges spanning inference engine code golf, Rust compiler speedup, and WASM rendering.