Open coding models
Can anyone run a top coding model themselves?
Contributes to: Can AI do the work?. Signal score: 67 / 100. Relative weight within this question: 1.
This only uses models Epoch AI has tested on SWE-bench Verified, and only those models.dev lists, so a new model can be missing for a while.
Open-weight means anyone can download the model, not that it is cheap to run. The largest open models need serious hardware.
Observed trend
Months behind closed models, at each new best open-weight score, by release month.
Months behind closed models, at each new best open-weight score, by release month. · 2026-01 – 2026-06
View data table
| Period / observation | Months behind closed models, at each new best open-weight score, by release month. |
|---|---|
| 2026-01 | 2 |
| 2026-04 | 2 |
| 2026-06 | 4 |
What it measures
- Metric
- Months the best open-weight model trails closed models on SWE-bench Verified
- Solved if
- Open-weight models match the best closed models as they are released
- Signal score
- 67 / 100. The best open-weight model trails closed models by 4 months, against a goal of none. A year behind scores 0%. How it is scored
- Status rule
- Catching up when the newest open-weight best trails closed models by fewer months than the first one did.
Each new best open-weight score
The best closed model scores 83%, from claude-opus-4-7, against 79% for the best open-weight model.
- kimi-k2.5 (2026-01): 74%, which claude-opus-4-5-20251101 reached 2 months earlier.
- deepseek-v4-pro (2026-04): 78%, which claude-opus-4-6 reached 2 months earlier.
- glm-5.2 (2026-06): 79%, which claude-opus-4-6 reached 4 months earlier.
Update history
The reading on each date we checked, separate from the historical observations above.
| Date | Value | Year over year | Status |
|---|---|---|---|
| 2026-11-07 | 4 months | — | Falling behind |
| 2026-11-06 | 4 months | — | Falling behind |
Source
| Source | Role | Measures | Latest data |
|---|---|---|---|
| models.dev | Scored measurement | Which AI models have open weights | 2026-11 |