When do multi-agent systems actually outperform single agents?
As individual LLMs grow more capable, does the advantage of splitting work across multiple agents still hold? This explores when coordination overhead makes MAS counterproductive.
"Single-agent or Multi-agent Systems? Why Not Both?" (2025) provides an empirical and theoretical analysis of when multi-agent systems (MAS) help versus hurt, with a finding that challenges the default toward multi-agent architectures.
The diminishing advantage. Prior studies reported MAS accuracy superiority across diverse domains. However, as frontier LLMs rapidly advance in long-context reasoning, memory retention, and tool usage, many limitations that originally motivated MAS designs are being mitigated by single-agent capability improvements. The empirical study finds that across various agentic applications, the performance gap between MAS and SAS narrows with stronger models — and SAS consistently outperforms MAS in a substantial portion of cases.
Three MAS defect types formalized as dependency graph problems:
Node-level defect: Both MAS and SAS performance are bottlenecked by the critical agent responsible for the most difficult subtask. MAS cannot escape the ceiling set by its weakest critical component. Adding more agents does not help if the hardest subtask remains unsolved.
Edge-level defect: Downstream agents become overwhelmed by inputs from upstream agents. In multi-way conversations or prolonged iterative refinements, high in-degree nodes (summarizers, synthesizers) receive more information than they can process effectively, leading to overthinking on edge cases. This is "analogous to the overthinking of the reasoning model, but rather than being lost in thinking, the agent becomes overwhelmed by inputs from upstream agents." MAS aggravates the problem because agents process much more data.
Path-level defect: Indecisive errors propagate through chains of agent interactions. Crucial context is lost or diluted when intermediate outputs are summarized or filtered. Even small information loss causes irreversible errors downstream via snowball effects. The specific failure mode: correct solutions proposed in earlier rounds get lost during summarization before reaching the next agent — "this loss is unrecoverable, as downstream agents no longer have access to the full previous results."
The hybrid solution. Confidence-guided routing between SAS and MAS — request cascading — selectively offloads requests based on difficulty. The approach improves accuracy by 1.1-12% while reducing costs up to 88%. AIME (hardest math) is the exception where MAS consistently outperforms, illustrating MAS value for extremely difficult tasks.
This extends When does adding more agents actually help systems?: the scaling laws quantify MAS overhead, while this paper shows the overhead becoming less worthwhile as single-agent capability increases. Since Why do multi-agent LLM systems converge without genuine deliberation?, MAS suffers from both coordination overhead AND pseudo-agreement — making the case for SAS with selective MAS escalation.
Inquiring lines that read this note 41
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How should organizational structure guide multi-agent system design?- How do multi-agent LLM systems fail at coordination and role consistency?
- What four decisions matter most in multi-agent system routing?
- How does hierarchical organization improve efficiency in multi-agent LLM teams?
- Why does diversity without expertise produce worse results than a single capable agent?
- How do multi-agent systems improve on single frontier models?
- How do static team decomposition and dynamic agent selection compare in efficiency?
- Which research tasks are better suited for multi-agent versus single-agent approaches?
- Does parallel task structure determine optimal multi-agent architecture?
- At what task difficulty does multi-agent decomposition become worth the coordination cost?
- Does internal task decomposition eliminate overhead from multi-agent coordination?
- What capability threshold do agents need to self-organize effectively?
- Does horizontal coordination improve with stronger individual agents?
- At what capability threshold does multi-agent coordination stop helping?
- Which layer of agent systems creates the largest capability gains in practice?
- How do evaluation methods differ for single versus multi-agent systems?
- Can a single dominant mechanism replace the combined effect of all five?
- Can multi-agent teams solve problems better than single models thinking longer?
- When does multi-agent scaling actually outperform static ensembles?
- When should multi-agent systems escalate rather than aggregate toward a single decision?
- Do multi-agent LLM systems scale better than centralized hierarchies?
- Do specialized agents outperform single agents with better orchestration?
- Do single-agent systems outperform multi-agent coordination as model capabilities grow?
- How do single-agent capabilities affect the trade-off between coordinator and team architectures?
- Why does organizational modularity reduce coordination cost at the cost of synergy?
- Do multi-agent systems need different unit of analysis for agency?
- What specific network sizes trigger coordination degradation in LLM systems?
- How does distributed coordination fail as agent networks scale?
- Do multi-agent LLM systems fail in measurably different ways than single agents?
- Can multiple small models outperform a single large model with good routing?
- Does model capability still matter once coordination infrastructure is optimized?
- What attacks are unique to multi-agent systems compared to single agents?
- When do multi-agent architectures create more attack surface than single-agent systems?
- Does the architectural penalty of MAS hold across different models and scenarios?
- Why do single-agent and multi-agent systems show different defense effectiveness?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
When does adding more agents actually help systems?
Multi-agent systems often fail in practice, but the reasons remain unclear. This research investigates whether coordination overhead, task properties, or system architecture determine when agents improve or degrade performance.
quantifies the overhead; this paper shows it becoming less worthwhile
-
Why do multi-agent LLM systems converge without genuine deliberation?
Multi-agent reasoning systems are designed to improve answers through debate, but often agents simply agree with early confident claims rather than genuinely disagreeing. What drives this pattern and how common is it?
MAS suffers coordination overhead AND pseudo-agreement
-
Does token spending drive multi-agent research performance?
Multi-agent systems outperform single agents substantially, but what actually accounts for that improvement? Is it intelligent coordination or simply spending more tokens on the same task?
if tokens drive performance, a single capable model may be more efficient than many smaller ones
-
Does more thinking time always improve reasoning accuracy?
Explores whether extending a model's thinking tokens linearly improves performance, or if there's a point beyond which additional reasoning becomes counterproductive.
edge-level defect is external-input-induced overthinking paralleling internal overthinking
-
Does multi-agent architecture make systems easier to attack?
When the same task runs on multiple agents instead of one, does the added complexity create new vulnerabilities? This matters because it would mean multi-agent design carries a built-in security cost.
a security column for the same ledger: one web agent alone at 11 percent attack success and inside a multi-agent system at 69 percent plus 6 percent partial leak, one model and one scenario; a different measure from this note's accuracy and cost
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgets
- Single-agent or Multi-agent Systems? Why Not Both?
- Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- Worse Together: How Performance Breaks Down in Multi-User Multi-Agent Teams
- Why Do Multi-agent LLM Systems Fail?
- Towards a Science of Scaling Agent Systems
- LLMs Corrupt Your Documents When You Delegate
- How we built our multi-agent research system
Original note title
multi-agent system advantages diminish as single-agent LLM capabilities improve — three defect types in MAS dependency graphs explain when single beats multi