Why do big companies seem to get AI agents working at scale faster than small ones do?
Why do larger firms scale AI agents faster than smaller organizations?
This explores why bigger companies seem to get AI agents working at scale before smaller ones do. The corpus has no direct study comparing firms by size, so this answer looks at what it says about the costs, budgets and organizational demands that decide who can scale agents at all.
This explores why bigger companies seem to get AI agents working at scale before smaller ones do. One caveat first: none of these notes compares firms by size, so the premise isn't tested here. What the corpus does show is where the advantage in scaling agents comes from, and much of it comes down to money spent while the agents run. In multi-agent systems, about 80% of the difference in performance comes from how many tokens the system is allowed to use, not from smarter coordination between agents How does test-time scaling work at the agent level?. Research agents work the same way. Giving them more search steps improves results along the same curve as giving them more reasoning tokens, with similar diminishing returns Do search steps follow the same scaling rules as reasoning tokens? How does test-time scaling work for individual research agents?. If agent quality is largely bought this way, a firm that can afford a bigger running budget gets better agents. That's a plain, unglamorous reason larger organizations might pull ahead.
The second factor is less obvious. Making agents do real work is harder than winning benchmarks. An analysis of 960 real occupational workflows found that agents do well on abstract contests but fail at long, multi-step professional tasks Why do agent benchmarks not predict real economic value?. Closing that gap takes things large firms tend to have already: documented processes, people who can build the support systems around a model, and room to absorb failed pilots. Governance points the same way. Risk to people grows with the amount of autonomy handed to an agent, so the safer approach is to set graded levels of autonomy with human checkpoints Does AI risk increase with the autonomy we give it?. Building that kind of oversight is organizational work, and bigger firms have more staff to do it.
The corpus also points against size being a lasting advantage. Small language models can handle most agent subtasks at 10 to 30 times lower cost, which makes a mixed design (small models by default, large ones only when needed) the economically sensible choice Can small language models handle most agent tasks?. A 35B-parameter model trained on real execution data competes with much larger models while sitting near the cheapest point on the cost-performance curve Does model efficiency matter more than peak capability for real work?. Data needs can be surprisingly small too: 78 carefully chosen demonstrations beat 10,000 generic examples for training agent behavior How does test-time scaling work for individual research agents?. And most recent progress in self-improving agents comes from the 'fast loop', meaning updates to prompts, memory and tools, which are cheap and reversible, rather than from retraining model weights Do self-improving agents really split into two distinct loops?. A small team can do that kind of tinkering.
One more angle comes from a different direction. Farrell and colleagues argue that large AI models resemble markets and bureaucracies more than they resemble minds. They are lossy summarizers that compress and reorganize what people have accumulated Are large AI models actually intelligent agents or social technologies?. Read this way, an agent amplifies the information structure an organization already has. Large firms may scale agents faster partly because they already run on the formalized, documented, bureaucratic knowledge these systems are good at processing. The resulting picture: big firms' current lead looks like an advantage of budget and organizational structure, not of model access. The cost trends in the corpus suggest that lead could narrow for smaller organizations willing to build small, specialized systems instead of buying scale.
Sources 9 notes
Research shows 80% of multi-agent performance variance comes from token budget, not coordination intelligence. LatentMAS and shared-KV-cache approaches offer ways to decouple performance gains from token costs.
Deep research agents improve with more search steps in a pattern mirroring the reasoning-token relationship, with both exhibiting diminishing returns. This reveals a new inference-compute axis beyond model capability alone.
Research shows that deep research agents exhibit test-time scaling laws where search steps scale similarly to reasoning tokens, and live search outperforms memorized retrieval on knowledge-intensive tasks. Data efficiency is extreme—78 curated demonstrations outperform 10K samples for agency.
ALE's analysis of 960 real occupational workflows shows agents excel at abstract contests but fail long-horizon professional tasks. The gap is not model capability but benchmark design—the field optimizes what it measures, and it has measured contests rather than work.
Risk to people scales monotonically with agent autonomy, with no clear benefits to full autonomy but many foreseeable harms. A governed spectrum of autonomy levels is safer and more practical than either unrestricted agents or exhaustive oversight.
Show all 9 sources
SLMs handle the repetitive, well-defined language tasks that constitute most agent work at 10–30× lower cost than LLMs, making heterogeneous architectures (SLMs by default, LLMs selective) the economically rational design pattern.
Occamy-1.0, a 35B-parameter model further trained on execution-grounded data and long-horizon trajectories, achieves competitive performance with much larger models while sitting at the low-cost knee of the Pareto frontier, suggesting that training for coordination and follow-through substitutes for raw scale in multi-step work.
A survey framework organizes self-improving agents into two update mechanisms: slow parametric loops updating foundation model weights, and fast non-parametric loops updating prompts, memory, and tools. Recent progress concentrates in the fast loop because scaffold updates are cheaper and reversible than weight updates.
Farrell and colleagues argue large models are lossy summarizers of human-accumulated information, akin to markets and bureaucracies. They compress cultural material into usable but incomplete representations, then reorganize it—without possessing understanding of truth or falsity.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
- Agents' Last Exam
- From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents
- Survey on Evaluation of LLM-based Agents
- Towards a Science of Scaling Agent Systems
- PostTrainBench: Can LLM Agents Automate LLM Post-Training?
- AI Agents That Matter
- How we built our multi-agent research system