Leaderboard

SWE-Bench Multimodalofficial site ↗

1 models scored · metric: resolve rate. Prices are the cheapest listed across all serving providers. Cost/run and Pts/$ are priced for the chat token profile — short turns, light history, little caching — an assistant in a product.

This benchmark has not been calibrated to a token profile, so the figures use the site default. Treat the ordering as indicative rather than tuned to SWE-Bench Multimodal. Profile: 1.5k in · 500 out · 20% cache hit · 8k context.

Scores are facts as publicly reported by labs (see report links below and on each model page) and aggregated via models.dev. SWE-Bench Multimodal is maintained by its own project — Model Pulse is not affiliated with or endorsed by it.