Data source

models.dev

models.dev is an open catalogue of AI models and the services that sell them, kept by the makers of OpenCode and its contributors. We use it to tell which models Epoch AI tested on SWE-bench Verified have open weights, then compare the best open and closed scores.

Provides measurements used by the linked signal.

Calculated from models.dev and its git history, as of 2026-11-01. MIT License.

Open models behind by4 months
Best open score79%
Best closed score83%

What the data shows

Computed from every record, as of 2026-11-01.

Each new best open-weight score

ReleasedOpen modelScoreClosed model that reached it firstMonths behind
2026-01kimi-k2.574%claude-opus-4-5-20251101 (2025-11)2
2026-04deepseek-v4-pro78%claude-opus-4-6 (2026-02)2
2026-06glm-5.279%claude-opus-4-6 (2026-02)4

Limitations