Model comparison
Coding benchmark scores and source-specific usage/cost evidence.
Sources & method
DeepSWE v1.1 · PASS@1 · 113 tasks · mini-swe-agent. Captured October 12, 2026; leaderboard updated September 22. Latest model names verified October 12.
Starting picks are the cheapest reported configuration within 10 or 3 score points of that cohort’s best. Expected-rate estimates and other reported averages are separate cohorts. Exact run snapshots, budgets and retries are unresolved; these are source-specific benchmark heuristics.
Costs are reported averages or estimates, not invoices. Missing latest measurements are blank in the tables and have no plotted proxy. Leaderboard · Methodology · Changelog