Leaderboard
SWE-Bench Proofficial site ↗
51 models scored · metric: resolve rate. Prices are the cheapest listed across all serving providers. Cost/run and Pts/$ are priced for the agentic token profile — tool loops re-send a growing transcript and think between calls.
A benchmark is priced for the workload it exercises, not a fixed input:output blend: an agent loop and a single hard question bill very differently on the same rate card. Profile: 12k in · 2k out · 3k reasoning · 70% cache hit · 32k context.
Scores are facts as publicly reported by labs (see report links below and on each model page) and aggregated via models.dev. SWE-Bench Pro is maintained by its own project — Model Pulse is not affiliated with or endorsed by it.
- 1.Laguna XS 2.140,476
- 2.MiniMax-M2.725,841
- 3.Qwen3.8 27B23,514
- 4.GPT-5.6 Luna23,413
- 5.Gemini 3 Flash Preview11,114
Score reports: anthropic.com · anthropic.com · console.sakana.ai · anthropic.com · alibabacloud.com · x.ai — full source URLs are linked on each model page.
Cheapest scorer: GPT-5.6 Luna at $0.06 input /M.