Skip to content

Leaderboard

OSWorld-Verifiedofficial site ↗

17 models scored · metric: success rate. Prices are the cheapest listed across all serving providers. Cost/run and Pts/$ are priced for the agentic token profile — tool loops re-send a growing transcript and think between calls.

A benchmark is priced for the workload it exercises, not a fixed input:output blend: an agent loop and a single hard question bill very differently on the same rate card. Profile: 12k in · 2k out · 3k reasoning · 70% cache hit · 32k context.

Scores are facts as publicly reported by labs (see report links below and on each model page) and aggregated via models.dev. OSWorld-Verified is maintained by its own project — Model Pulse is not affiliated with or endorsed by it.

Best value · top 5 by pts per dollar · agentic profile
  1. 1.Muse Glimmer 30B11,982
  2. 2.MiniMax-M311,498
  3. 3.Gemini 3.5 Flash Lite10,585
  4. 4.Gemini 3.5 Flash9,639
  5. 5.GPT-5.59,583
17 models
#
🥇Qwen3.8 Max Previewalibaba
86.1
$2$6$0.0432,0071M
🥈Claude Fable 5anthropic
85
$3$18.50$0.1117641M
🥉Claude Opus 4.8anthropic
83.4
$0.425$2.13$0.0165,0581.05M
4Gemini 3.6 Flashgoogle
83
$0.375$1.88$0.0117,4931.05M
5Claude Sonnet 5anthropic
81.2
$1.44$7.20$0.0561,4531M
6Muse Spark 1.1meta
80.8
$1.25$4.25$0.0292,7611.05M
7GPT-5.5openai
78.7
$0.188$1.130.821¢9,5831.05M
8Claude Sonnet 4.6anthropic
78.5
$0.9$5.55$0.0332,3531M
9Gemini 3.5 Flashgoogle
78.4
$0.186$1.110.813¢9,6391.05M
10Claude Opus 4.7anthropic
78
$4$20$0.0671,1681.05M
11Gemini 3.1 Pro Previewgoogle
76.2
$1$6$0.0352,1911.05M
12GPT-5.4openai
75
$0.75$6$0.0352,1631.05M
13Gemini 3.5 Flash Litegoogle
74
$0.15$1.250.699¢10,5851.05M
14GPT-5.4 miniopenai
72.1
$0.375$4$0.0223,227400K
15MiniMax-M3minimax
70.06
$0.225$0.90.609¢11,4981.05M
16Muse Glimmer 30Bmeta
65.9
$0.2$0.80.550¢11,982131K
17GPT-5.4 nanoopenai
39
$0.18$1.100.662¢5,8881.05M

Score reports: alibabacloud.com · anthropic.com · deepmind.google · anthropic.com · ai.meta.com · openai.com — full source URLs are linked on each model page.

Cheapest scorer: Gemini 3.5 Flash Lite at $0.15 input /M.