Leaderboard
OSWorld-Verifiedofficial site ↗
17 models scored · metric: success rate. Prices are the cheapest listed across all serving providers. Cost/run and Pts/$ are priced for the agentic token profile — tool loops re-send a growing transcript and think between calls.
A benchmark is priced for the workload it exercises, not a fixed input:output blend: an agent loop and a single hard question bill very differently on the same rate card. Profile: 12k in · 2k out · 3k reasoning · 70% cache hit · 32k context.
Scores are facts as publicly reported by labs (see report links below and on each model page) and aggregated via models.dev. OSWorld-Verified is maintained by its own project — Model Pulse is not affiliated with or endorsed by it.
- 1.Muse Glimmer 30B11,982
- 2.MiniMax-M311,498
- 3.Gemini 3.5 Flash Lite10,585
- 4.Gemini 3.5 Flash9,639
- 5.GPT-5.59,583
Score reports: alibabacloud.com · anthropic.com · deepmind.google · anthropic.com · ai.meta.com · openai.com — full source URLs are linked on each model page.
Cheapest scorer: Gemini 3.5 Flash Lite at $0.15 input /M.