Task Efficiency IntelligencePass@1 Accuracy vs Retry Overhead
Cost Per Successful Task Optimizer
Cheap models with low accuracy often cost significantly more per completed job than frontier models due to compounding failure retries. This calculator computes the true expected cost per resolved task: Effective Cost = (Cost per Attempt) / (Success Probability).
Optimal Choice: Gemini 2.5 Flash-LiteLowest Cost per Solved Task
Effective Cost: $0.00538 / solved task (40% pass@1) vs OpenAI o3-pro's $0.8615 / solved task.
Fleet Target (1,000 tasks/mo):$5.38/mo
Benchmark Notice:Preset pass@1 accuracy values are illustrative published baselines (SWE-bench Verified, LiveCodeBench, etc.). Adjust sliders to reflect your system prompt, scaffolding, and task specifics.
Benchmark & Task Parameters
Select benchmark accuracy profile or customize workload token volumes.
Input Tokens / Try18,000
Output Tokens / Try2,500
Prompt Caching Rate40%
Max Retries / Task
Monthly Target Tasks
Cost Per Successful Resolution LeaderboardSorted by Lowest Effective Cost
#1Gemini 2.5 Flash-Lite(Google)BEST VALUE
$0.00538/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00215
Avg Tries to Solve2.5 tries
Cost PremiumBaseline (0%)
Monthly Fleet (1,000 tasks): $5.38Details
#2DeepSeek-V3 (Legacy API Alias)(DeepSeek)
$0.00578/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00231
Avg Tries to Solve2.5 tries
Cost Premium+7%
Monthly Fleet (1,000 tasks): $5.782Details
#3Mistral Small 4(Mistral AI)
$0.00807/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00323
Avg Tries to Solve2.5 tries
Cost Premium+50%
Monthly Fleet (1,000 tasks): $8.07Details
#4Command R (08-2024)(Cohere)
$0.00807/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00323
Avg Tries to Solve2.5 tries
Cost Premium+50%
Monthly Fleet (1,000 tasks): $8.07Details
#5DeepSeek-V4.1-Reasoner(DeepSeek)
$0.0107/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00428
Avg Tries to Solve2.5 tries
Cost Premium+99%
Monthly Fleet (1,000 tasks): $10.689Details
#6Llama 4 Scout (17B Active / 109B MoE) — Together AI(Meta / Together)
$0.0118/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00471
Avg Tries to Solve2.5 tries
Cost Premium+119%
Monthly Fleet (1,000 tasks): $11.7875Details
#7DeepSeek-V4.1-Flash(DeepSeek)
$0.0121/ solved task
Pass@1 Success52%
Raw Cost / Try$0.00628
Avg Tries to Solve1.9 tries
Cost Premium+125%
Monthly Fleet (1,000 tasks): $12.0831Details
#8Llama 4 Vivas(Meta / Together)
$0.0131/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00526
Avg Tries to Solve2.5 tries
Cost Premium+144%
Monthly Fleet (1,000 tasks): $13.1425Details
#9Codestral (Current Generation)(Mistral AI)
$0.0143/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00571
Avg Tries to Solve2.5 tries
Cost Premium+165%
Monthly Fleet (1,000 tasks): $14.265Details
#10Qwen 2.5 72B Instruct — Together AI(Alibaba / Qwen)
$0.0151/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00604
Avg Tries to Solve2.5 tries
Cost Premium+181%
Monthly Fleet (1,000 tasks): $15.10Details
#11Grok 2 mini(xAI)
$0.0152/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00610
Avg Tries to Solve2.5 tries
Cost Premium+183%
Monthly Fleet (1,000 tasks): $15.25Details
#12GPT-5.6 Mini(OpenAI)
$0.0161/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00646
Avg Tries to Solve2.5 tries
Cost Premium+200%
Monthly Fleet (1,000 tasks): $16.14Details
#13Llama 4 Maverick (400B) — Together AI(Meta / Together)
$0.0175/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00698
Avg Tries to Solve2.5 tries
Cost Premium+225%
Monthly Fleet (1,000 tasks): $17.4625Details
#14Mistral Large 3(Mistral AI)
$0.0216/ solved task
Pass@1 Success44%
Raw Cost / Try$0.00951
Avg Tries to Solve2.3 tries
Cost Premium+302%
Monthly Fleet (1,000 tasks): $21.6136Details
#15Grok 4.6 Mini(xAI)
$0.0226/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00904
Avg Tries to Solve2.5 tries
Cost Premium+320%
Monthly Fleet (1,000 tasks): $22.60Details
#16GPT-5.6 Luna(OpenAI)
$0.0241/ solved task
Pass@1 Success22%
Raw Cost / Try$0.00530
Avg Tries to Solve4.5 tries
Cost Premium+348%
Monthly Fleet (1,000 tasks): $24.1091Details
#17Gemini 2.5 Flash(Google)
$0.0243/ solved task
Pass@1 Success40%
Raw Cost / Try$0.00971
Avg Tries to Solve2.5 tries
Cost Premium+351%
Monthly Fleet (1,000 tasks): $24.265Details
#18Qwen3 235B-A22B(Alibaba / Qwen)
$0.0269/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0108
Avg Tries to Solve2.5 tries
Cost Premium+400%
Monthly Fleet (1,000 tasks): $26.90Details
#19Qwen 2.5 Coder 32B — Together AI(Alibaba / Qwen)
$0.0364/ solved task
Pass@1 Success45%
Raw Cost / Try$0.0164
Avg Tries to Solve2.2 tries
Cost Premium+577%
Monthly Fleet (1,000 tasks): $36.4444Details
#20Gemini 3.8 Flash(Google)
$0.0429/ solved task
Pass@1 Success42%
Raw Cost / Try$0.0180
Avg Tries to Solve2.4 tries
Cost Premium+697%
Monthly Fleet (1,000 tasks): $42.8929Details
#21OpenAI o5-mini(OpenAI)
$0.0452/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0181
Avg Tries to Solve2.5 tries
Cost Premium+740%
Monthly Fleet (1,000 tasks): $45.20Details
#22Claude Haiku 4.5(Anthropic)
$0.0601/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0240
Avg Tries to Solve2.5 tries
Cost Premium+1016%
Monthly Fleet (1,000 tasks): $60.05Details
#23OpenAI o4-mini(OpenAI)
$0.0622/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0249
Avg Tries to Solve2.5 tries
Cost Premium+1055%
Monthly Fleet (1,000 tasks): $62.15Details
#24OpenAI o3(OpenAI)
$0.0628/ solved task
Pass@1 Success72%
Raw Cost / Try$0.0452
Avg Tries to Solve1.4 tries
Cost Premium+1067%
Monthly Fleet (1,000 tasks): $62.7778Details
#25Claude Sonnet 5(Anthropic)
$0.0686/ solved task
Pass@1 Success70%
Raw Cost / Try$0.0480
Avg Tries to Solve1.4 tries
Cost Premium+1176%
Monthly Fleet (1,000 tasks): $68.6286Details
#26Command A(Cohere)
$0.0822/ solved task
Pass@1 Success65%
Raw Cost / Try$0.0534
Avg Tries to Solve1.5 tries
Cost Premium+1428%
Monthly Fleet (1,000 tasks): $82.2154Details
#27Command R+ (08-2024)(Cohere)
$0.0828/ solved task
Pass@1 Success65%
Raw Cost / Try$0.0538
Avg Tries to Solve1.5 tries
Cost Premium+1438%
Monthly Fleet (1,000 tasks): $82.7692Details
#28Grok 4.6(xAI)
$0.1005/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0402
Avg Tries to Solve2.5 tries
Cost Premium+1768%
Monthly Fleet (1,000 tasks): $100.50Details
#29Llama 3.1 405B — Together AI(Meta / Together)
$0.1104/ solved task
Pass@1 Success65%
Raw Cost / Try$0.0718
Avg Tries to Solve1.5 tries
Cost Premium+1952%
Monthly Fleet (1,000 tasks): $110.38Details
#30GPT-5.6 Terra(OpenAI)
$0.1105/ solved task
Pass@1 Success48%
Raw Cost / Try$0.0530
Avg Tries to Solve2.1 tries
Cost Premium+1954%
Monthly Fleet (1,000 tasks): $110.50Details
#31Grok 2(xAI)
$0.1220/ solved task
Pass@1 Success50%
Raw Cost / Try$0.0610
Avg Tries to Solve2.0 tries
Cost Premium+2168%
Monthly Fleet (1,000 tasks): $122.00Details
#32Gemini 3.1 Pro Preview(Google)
$0.1326/ solved task
Pass@1 Success40%
Raw Cost / Try$0.0530
Avg Tries to Solve2.5 tries
Cost Premium+2365%
Monthly Fleet (1,000 tasks): $132.60Details
#33Gemini 3.8 Pro(Google)
$0.1401/ solved task
Pass@1 Success65%
Raw Cost / Try$0.0911
Avg Tries to Solve1.5 tries
Cost Premium+2505%
Monthly Fleet (1,000 tasks): $140.12Details
#34GPT-5.6 Sol(OpenAI)
$0.1550/ solved task
Pass@1 Success62%
Raw Cost / Try$0.0961
Avg Tries to Solve1.6 tries
Cost Premium+2780%
Monthly Fleet (1,000 tasks): $154.97Details
#35Claude Opus 5(Anthropic)
$0.1623/ solved task
Pass@1 Success74%
Raw Cost / Try$0.1201
Avg Tries to Solve1.4 tries
Cost Premium+2917%
Monthly Fleet (1,000 tasks): $162.30Details
#36GPT-6 Astra(OpenAI)
$0.3532/ solved task
Pass@1 Success68%
Raw Cost / Try$0.2402
Avg Tries to Solve1.5 tries
Cost Premium+6466%
Monthly Fleet (1,000 tasks): $353.24Details
#37Claude Fable 5.1(Anthropic)
$0.3612/ solved task
Pass@1 Success65%
Raw Cost / Try$0.2348
Avg Tries to Solve1.5 tries
Cost Premium+6614%
Monthly Fleet (1,000 tasks): $361.23Details
#38OpenAI o1(OpenAI)
$0.5631/ solved task
Pass@1 Success65%
Raw Cost / Try$0.3660
Avg Tries to Solve1.5 tries
Cost Premium+10366%
Monthly Fleet (1,000 tasks): $563.08Details
#39OpenAI o3-pro(OpenAI)
$0.8615/ solved task
Pass@1 Success65%
Raw Cost / Try$0.5600
Avg Tries to Solve1.5 tries
Cost Premium+15914%
Monthly Fleet (1,000 tasks): $861.54Details