Skip to content
Model Pulse

Leaderboard

Toolathlon Verified

3 models scored · metric: pass@1. Prices are the cheapest listed across all serving providers. Cost/run and Pts/$ are priced for the chat token profile — short turns, light history, little caching — an assistant in a product.

This benchmark has not been calibrated to a token profile, so the figures use the site default. Treat the ordering as indicative rather than tuned to Toolathlon Verified. Profile: 1.5k in · 500 out · 20% cache hit · 8k context.

Scores are facts as publicly reported by labs (see report links below and on each model page) and aggregated via models.dev. Toolathlon Verified is maintained by its own project — Model Pulse is not affiliated with or endorsed by it.

Best value · top 3 by pts per dollar · chat profile
  1. 1.DeepSeek V4 Flash 0731860,202
  2. 2.Muse Spark 1.120,086
  3. 3.Qwen3.8 Max Preview12,889
3 models
#
🥇Muse Spark 1.1meta
75.6
$1.25$4.250.376¢20,0861.05M
🥈Qwen3.8 Max Previewalibaba
72.5
$2$60.563¢12,8891M
🥉DeepSeek V4 Flash 0731deepseek
70.3
$0.035$0.070.008¢860,2021.31M
1–3 of 3 models

Score reports: ai.meta.com · alibabacloud.com · api-docs.deepseek.com — full source URLs are linked on each model page.

Cheapest scorer: DeepSeek V4 Flash 0731 at $0.035 input /M.