Data source

Epoch AI Benchmarking Hub

Epoch AI runs and collects AI benchmark results. We keep its own SWE-bench Verified and MirrorCode results, and only scores and costs for results it collected from other projects.

Used to score: Cost of a hard task.

Provides measurements for the scored signals linked below.

Epoch AI, 'Capabilities & benchmarking'. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks. Results collected from other projects keep their original terms, and we quote only top scores from those.

SWE-bench Verified, best83%
MirrorCode, best79%
DeepSWE, best74%
FrontierSWE, best66%

What the data shows

Computed from every record, as of 2026-04.

Best score by benchmark

BenchmarkBest scoreModel
SWE-bench Verified83%claude-opus-4-7
MirrorCode79%claude-opus-5-5
DeepSWE74%gpt-6-astra
FrontierSWE66%gpt-6-astra
FrontierCode55%claude-opus-5-5

Limitations