AI agents get better mostly by spending more tokens — so cheaper tokens just mean bigger bills, not smaller ones.
Why do agentic AI workflows increase token volume faster than prices fall?
This explores why agent-style AI, where models plan, call tools and loop through many steps, ends up consuming tokens faster than falling per-token prices can offset. The corpus has no data on price trends, but it has a lot on why agents burn so many tokens.
This explores why agentic AI's token bills keep growing even as each token gets cheaper. The corpus doesn't track price declines directly, so it can't confirm the race between volume and price. It does explain the volume side well, and the explanation is surprising. Agents use more tokens partly because spending more tokens is how they get better. Anthropic's internal evaluations found that token usage alone explains about 80 percent of the performance differences in multi-agent research systems Does token spending drive multi-agent research performance?. When quality tracks spending that closely, every price cut becomes room to spend more. Builders usually use the savings to run more agents, longer loops and deeper searches, not to cut the bill How does test-time scaling work at the agent level?.
The second reason is waste. Much of what agents consume isn't useful work. When researchers automatically tuned agent harnesses (the scaffolding that manages an agent's actions, memory and tool results) across many environments, they found four mechanisms that cut token traffic by 44.7 to 49.0 percent with comparable performance Can agent harnesses be automatically optimized across many environments?. Microsoft's ACON method cut peak token usage 26 to 54 percent just by rewriting the instructions that tell an agent how to compress its own context Can prompt optimization cut agent token usage without retraining?. Default agent setups, in other words, leave about half their tokens on the table. Another study sharpens the point: agent performance tracks 'effective feedback' (informative, non-redundant signal the agent actually uses) far better than raw token count Does raw token spending actually predict agent performance?. Much of the volume growth is redundant re-reading and repeated context.
This suggests counting tokens may be the wrong measure. A 115-day case study of a persistent agent found that 82.9 percent of its tokens were cache reads, meaning the same context was reused rather than generated fresh. The authors argue the useful unit of cost is the finished artifact, not the token Do persistent agents really cost less per token?. Work on compact models makes the same point from the other side: cost and latency pile up over a whole multi-step episode. A smaller model trained to follow through reliably can beat a larger one on total cost, even if it isn't cheaper per token Does model efficiency matter more than peak capability for real work?.
There's also a bigger-picture reading. One theoretical note argues AI marks a shift from the 'age of the commodity' to the 'age of the token.' Value is made through tokens generated in context at the moment of use, not through identical mass-produced goods, and that dynamic tends toward inflationary devaluation Is AI fundamentally changing how value gets produced?. Cheap, endlessly producible tokens invite more production. Payment data shows this becoming routine: on the x402 agent-payment rails, the median time from funding an agent's wallet to its first spend fell from 73 days to 18 minutes Are AI agent wallets becoming genuinely operational instead of experimental?.
The takeaway you might not expect: the growth in token volume is partly a choice and partly avoidable. The choice is to spend tokens because spending buys performance. The avoidable part is harness inefficiency that roughly doubles consumption. The gains available from smarter context handling appear to be larger than a typical round of price cuts.
Sources 9 notes
Anthropic's internal evals show token spending alone accounts for 80% of performance variance in multi-agent research systems. Model capability upgrades deliver larger gains than doubling token budget, suggesting efficiency matters as much as quantity.
Research shows 80% of multi-agent performance variance comes from token budget, not coordination intelligence. LatentMAS and shared-KV-cache approaches offer ways to decouple performance gains from token costs.
Cross-environment harness optimization yielded four mechanisms (action execution, context compaction, observation handling, delegated reading) that reduced token traffic by 44.7–49.0% while maintaining comparable performance on a 51-task benchmark, suggesting harness-level gains are orthogonal to model improvements.
Microsoft's ACON method reduces agent token consumption and improves task success by iteratively refining compression guidelines through failure analysis, not weight updates. This approach works across proprietary LLM agents and costs under $2 per benchmark.
Effective Feedback Compute—crediting only informative, valid, non-redundant feedback retained for decisions—predicts performance (R²≈0.94) far better than raw tokens or tool calls (R²≈0.33–0.42). The scaling lever is feedback quality, not quantity of interaction.
Show all 9 sources
A 115-day case study found 82.9% of tokens were cache reads. When context persists and reuses, the meaningful cost denominator becomes completed artifacts, not individual tokens.
Occamy-1.0, a 35B-parameter model further trained on execution-grounded data and long-horizon trajectories, achieves competitive performance with much larger models while sitting at the low-cost knee of the Pareto frontier, suggesting that training for coordination and follow-through substitutes for raw scale in multi-step work.
AI production is organized around contextual token-flows generated at point of use, not identical mass-produced objects. This creates different effects than commodification: inflationary devaluation, contextual variation, and skill transformation from production to validation.
Median time from wallet funding to first spend collapsed from 73 days to 18 minutes, and repeat-funding rates climbed from 71% to 89%, signaling agentic micropayments transitioned to habitual use.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- How we built our multi-agent research system
- Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
- Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgets
- RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
- SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent Harness
- Worse Together: How Performance Breaks Down in Multi-User Multi-Agent Teams
- Scaling Laws for Agent Harnesses via Effective Feedback Compute
- Don't Break the Cache: An Evaluation of Prompt Caching for Long-Horizon Agentic Tasks