Task Efficiency IntelligencePass@1 Accuracy vs Retry Overhead
Cost Per Successful Task Optimizer
Cheap models with low accuracy often cost significantly more per completed job than frontier models due to compounding failure retries. This calculator computes the true expected cost per resolved task: Effective Cost = (Cost per Attempt) / (Success Probability).
Optimal Choice: Qwen 2.5 Coder 32B — Together AILowest Cost per Solved Task
Effective Cost: $0.00409 / solved task (45% pass@1) vs OpenAI o3-pro's $0.7508 / solved task.
Fleet Target (1,000 tasks/mo):$4.0889/mo
Benchmark & Task Parameters
Select benchmark accuracy profile or customize workload token volumes.
Input Tokens / Try18,000
Output Tokens / Try2,500
Prompt Caching Rate40%
Max Retries / Task
Monthly Target Tasks
Cost Per Successful Resolution LeaderboardSorted by Lowest Effective Cost
#1Qwen 2.5 Coder 32B — Together AI(Alibaba / Qwen)BEST VALUE
$0.00409/ solved task
Pass@1 Success45%
Raw Cost / Try$0.00184
Avg Tries to Solve2.2 tries
Cost PremiumBaseline (0%)
Monthly Fleet (1,000 tasks): $4.0889Details
#2Gemini 2.5 Flash(Google)
$0.00424/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00169
Avg Tries to Solve2.5 tries
Cost Premium+4%
Monthly Fleet (1,000 tasks): $4.2375Details
#3Gemini 2.5 Flash-Lite(Google)
$0.00565/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00226
Avg Tries to Solve2.5 tries
Cost Premium+38%
Monthly Fleet (1,000 tasks): $5.65Details
#4DeepSeek-V3(DeepSeek)
$0.00578/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00231
Avg Tries to Solve2.5 tries
Cost Premium+41%
Monthly Fleet (1,000 tasks): $5.782Details
#5Mistral Small 4(Mistral AI)
$0.00807/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00323
Avg Tries to Solve2.5 tries
Cost Premium+97%
Monthly Fleet (1,000 tasks): $8.07Details
#6Command R (08-2024)(Cohere)
$0.00807/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00323
Avg Tries to Solve2.5 tries
Cost Premium+97%
Monthly Fleet (1,000 tasks): $8.07Details
#7Codestral 2501(Mistral AI)
$0.0102/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00409
Avg Tries to Solve2.5 tries
Cost Premium+150%
Monthly Fleet (1,000 tasks): $10.23Details
#8Llama 4 Scout (17B Active / 109B MoE) — Together AI(Meta / Open)
$0.0124/ solved task
Pass@1 Success38%
Raw Cost / Try$0.00471
Avg Tries to Solve2.6 tries
Cost Premium+203%
Monthly Fleet (1,000 tasks): $12.4079Details
#9Qwen 2.5 72B Instruct — Together AI(Alibaba / Qwen)
$0.0151/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00604
Avg Tries to Solve2.5 tries
Cost Premium+269%
Monthly Fleet (1,000 tasks): $15.10Details
#10Grok 2 mini(xAI)
$0.0152/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00610
Avg Tries to Solve2.5 tries
Cost Premium+273%
Monthly Fleet (1,000 tasks): $15.25Details
#11DeepSeek-V4-Flash(DeepSeek)
$0.0157/ solved task
Pass@1 Success52%
Raw Cost / Try$0.00815
Avg Tries to Solve1.9 tries
Cost Premium+283%
Monthly Fleet (1,000 tasks): $15.6785Details
#12Mistral Large 3(Mistral AI)
$0.0216/ solved task
Pass@1 Success44%
Raw Cost / Try$0.00951
Avg Tries to Solve2.3 tries
Cost Premium+429%
Monthly Fleet (1,000 tasks): $21.6136Details
#13GPT-5.6 Luna(OpenAI)
$0.0241/ solved task
Pass@1 Success22%
Raw Cost / Try$0.00530
Avg Tries to Solve4.5 tries
Cost Premium+490%
Monthly Fleet (1,000 tasks): $24.1091Details
#14Gemini 3.8 Flash(Google)
$0.0429/ solved task
Pass@1 Success42%
Raw Cost / Try$0.0180
Avg Tries to Solve2.4 tries
Cost Premium+949%
Monthly Fleet (1,000 tasks): $42.8929Details
#15Llama 4 Maverick (400B) — Together AI(Meta / Open)
$0.0460/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0184
Avg Tries to Solve2.5 tries
Cost Premium+1025%
Monthly Fleet (1,000 tasks): $46.00Details
#16Claude Haiku 4.5(Anthropic)
$0.0601/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0240
Avg Tries to Solve2.5 tries
Cost Premium+1369%
Monthly Fleet (1,000 tasks): $60.05Details
#17OpenAI o4-mini(OpenAI)
$0.0622/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0249
Avg Tries to Solve2.5 tries
Cost Premium+1420%
Monthly Fleet (1,000 tasks): $62.15Details
#18OpenAI o3(OpenAI)
$0.0628/ solved task
Pass@1 Success72%
Raw Cost / Try$0.0452
Avg Tries to Solve1.4 tries
Cost Premium+1435%
Monthly Fleet (1,000 tasks): $62.7778Details
#19Claude Sonnet 5(Anthropic)
$0.0686/ solved task
Pass@1 Success70%
Raw Cost / Try$0.0480
Avg Tries to Solve1.4 tries
Cost Premium+1578%
Monthly Fleet (1,000 tasks): $68.6286Details
#20Command R+ (08-2024)(Cohere)
$0.0828/ solved task
Pass@1 Success65%
Raw Cost / Try$0.0538
Avg Tries to Solve1.5 tries
Cost Premium+1924%
Monthly Fleet (1,000 tasks): $82.7692Details
#21Llama 3.1 405B — Together AI(Meta)
$0.1104/ solved task
Pass@1 Success65%
Raw Cost / Try$0.0718
Avg Tries to Solve1.5 tries
Cost Premium+2600%
Monthly Fleet (1,000 tasks): $110.38Details
#22GPT-5.6 Terra(OpenAI)
$0.1105/ solved task
Pass@1 Success48%
Raw Cost / Try$0.0530
Avg Tries to Solve2.1 tries
Cost Premium+2602%
Monthly Fleet (1,000 tasks): $110.50Details
#23Grok 2(xAI)
$0.1220/ solved task
Pass@1 Success50%
Raw Cost / Try$0.0610
Avg Tries to Solve2.0 tries
Cost Premium+2884%
Monthly Fleet (1,000 tasks): $122.00Details
#24Gemini 3.1 Pro Preview(Google)
$0.1326/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0530
Avg Tries to Solve2.5 tries
Cost Premium+3143%
Monthly Fleet (1,000 tasks): $132.60Details
#25GPT-5.6 Sol(OpenAI)
$0.1550/ solved task
Pass@1 Success62%
Raw Cost / Try$0.0961
Avg Tries to Solve1.6 tries
Cost Premium+3690%
Monthly Fleet (1,000 tasks): $154.97Details
#26Claude Opus 5(Anthropic)
$0.1623/ solved task
Pass@1 Success74%
Raw Cost / Try$0.1201
Avg Tries to Solve1.4 tries
Cost Premium+3869%
Monthly Fleet (1,000 tasks): $162.30Details
#27GPT-6 Astra(OpenAI)
$0.3532/ solved task
Pass@1 Success68%
Raw Cost / Try$0.2402
Avg Tries to Solve1.5 tries
Cost Premium+8539%
Monthly Fleet (1,000 tasks): $353.24Details
#28Claude Fable 5.1(Anthropic)
$0.3612/ solved task
Pass@1 Success65%
Raw Cost / Try$0.2348
Avg Tries to Solve1.5 tries
Cost Premium+8734%
Monthly Fleet (1,000 tasks): $361.23Details
#29OpenAI o1(OpenAI)
$0.5631/ solved task
Pass@1 Success65%
Raw Cost / Try$0.3660
Avg Tries to Solve1.5 tries
Cost Premium+13671%
Monthly Fleet (1,000 tasks): $563.08Details
#30OpenAI o3-pro(OpenAI)
$0.7508/ solved task
Pass@1 Success65%
Raw Cost / Try$0.4880
Avg Tries to Solve1.5 tries
Cost Premium+18261%
Monthly Fleet (1,000 tasks): $750.77Details