Daily Tech Wizard Newsletter

Stories / / By Daily Tech Wizard

AI agent teams cost up to 5.1x more but barely beat solo

Teams of AI agents cost between 1.8x and 5.1x more than single agents, and they barely beat them.

AI agent teams cost more, gain little. Vals AI tested solo agents against teams on the Vibe Code Bench.

Teams cost 1.8x to 5.1x more. Vals AI tested GPT-6 Sol and Claude Opus 5.5 solo and as teams, at medium and maximum reasoning effort.

Only one of four comparisons was significant. GPT-6 Sol at medium reasoning, where the team scored 7.3 points higher. At maximum reasoning, neither model gained a real advantage.

Anthropic's own tests show shrinking gains. On a knowledge base task, the score went from 0.53 with one agent to 0.70 with ten, then 0.74 with 100.

Noam Brown: teams mainly buy speed. Four agents solved tasks twice as fast but also cost twice as much. Web research and math parallelize well; writing a novel doesn't.

Only one of the four team-versus-solo comparisons showed a statistically significant improvement: GPT-6 Sol at medium reasoning, where the team scored 7.3 points higher. At maximum reasoning, the team setup gave neither Sol nor Opus 5.5 any real advantage. The results suggest the extra cost isn't worth it in most cases, especially when models already run at full compute.

OpenAI researcher Noam Brown said on the Dwarkesh Podcast that multi-agent systems mainly buy speed, not better quality. Four agents solved tasks twice as fast but also cost twice as much. He said it depends on the task: web research and math parallelize well, but writing a novel doesn't. OpenAI developer Eric Provencher has warned against agent swarms for the same reason, calling the problem a coordination tax.

Would you pay several times more for a team of agents?