Do AI performance prices fall faster when capabilities debut?
Explores whether newly state-of-the-art AI capabilities command premium pricing that erodes over time, and how quickly that erosion happens across different benchmarks.
Epoch AI find that within their five primary capability benchmarks, "the cost of a given level of performance often falls fastest right after that level is first achieved, that is, when it is state of the art (SOTA)." Averaged across the five, cost falls "66% per quarter (75× per year) for performance that has just debuted as SOTA"; "two years later, prices fall half as fast, at 32% per quarter (4.7× per year)." The pattern holds broadly: "In three of the five primary benchmarks, and all of the secondary ones, the rate of cost decline falls after SOTA debut." The two exceptions among the primary set, Chess Puzzles and Mystery Game Puzzles, drift the other way, but "the acceleration amounts to only a few percentage points." Per-benchmark decline rates otherwise cluster tightly, "ranging from 43% per quarter for Chess Puzzles to 53% per quarter for FrontierMath, tiers 1–3."
Epoch AI's proposed explanation is competitive rather than purely technical: "when a performance level is first achieved, AI companies can briefly charge a premium for it, before competition and technological improvement quickly drive down the price. In time, that dynamic slows." A newly-SOTA capability is priced, in effect, like a temporary monopoly; competing labs and newer, cheaper models erode that premium quickly at first, then more slowly as the performance tier matures and fewer competitors remain to undercut it further.
This refines the headline rate in How fast is AI capability becoming cheaper to produce? (sibling note): the 47%-per-quarter figure is a cross-benchmark average that flattens a two-speed curve — fast while a capability is new, slower as the tier ages — into one number. It is also a different cost lens than How much progress have AI agents actually made on NanoGPT?, which prices an agent's R&D optimization contribution as a one-time dollar threshold rather than following a price over calendar time, and than When do AI agents outperform human research experts?, which compares a fixed per-run agent cost to a human cost rather than tracking any price trend.
Epoch AI calls the SOTA-premium explanation "one possible explanation," not a settled mechanism, and notes the pattern "is not universal" — two of five primary benchmarks run the other way, even if only slightly. The same major caveats apply as to the headline rate: possible benchmaxxing, the frontier-search assumption that overstates realized user savings, and a data window of "barely three years." The finding supports a narrower claim than "AI gets cheaper over time": within these benchmarks, newness commands a premium that competition erodes on a roughly two-year-ish half-life, but whether that premium-decay dynamic generalizes to capabilities outside these five benchmarks is not established here.
Inquiring lines that read this note 28
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What fundamentally drives AI inference pricing and cost decline patterns?- How sensitive is data center cost to hardware depreciation assumptions?
- Does annualized capex or operating expense drive inference pricing?
- What margin do cloud providers add on top of infrastructure costs?
- How are enterprises shifting their spending on AI capabilities?
- Do R&D labor costs scale with computing power the same way hardware costs do?
- Does competitive pricing pressure explain most AI cost decline patterns?
- What time horizon does the two-year performance price slowdown suggest?
- Do AI capabilities mature on a predictable price decay schedule?
- How universal is the state-of-the-art premium effect across AI benchmarks?
- Does real world AI cost drop as fast as benchmark performance prices?
- Why do AI performance prices fall fastest right after reaching state of the art?
- What is driving the price increase in high-bandwidth memory supplies?
- Will memory's share of chip costs continue rising through 2026?
- How do gross margins and operating margins differ for AI model providers?
- Why do enterprise AI deployments not reduce customer costs?
- Can inference prices fall faster than AI usage grows?
- How quickly will AI service costs fall enough to trigger widespread automation?
- Why do closed-weight models show faster price declines than open-weight ones?
- How reliable is the hardware price deflator in separating technical from market effects?
- Why does high-end benchmark performance decline in price faster than low-end?
- Will declining compute prices eventually eliminate scale as a barrier to automation?
- Why do AI labs lose more money than they earn from revenue?
- How much of frontier AI cost growth comes from chips versus skilled staff?
- Why do AI labs face shorter repayment windows than traditional software companies?
- What timeline do AI labs need to recoup model development costs before obsolescence?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
How fast is AI capability becoming cheaper to produce?
Epoch AI tracked whether the cost of achieving fixed AI performance levels is falling, and if so, how that decline compares to other transformative technologies throughout history.
sibling note: this note explains the two-speed shape behind that note's single average rate
-
How much progress have AI agents actually made on NanoGPT?
METR compares AI agent optimization to human researcher productivity on a popular benchmark. By measuring where their improvement curves intersect, they ask whether autonomous systems are meaningfully accelerating AI R&D or mostly chasing noise.
contrast: a one-time dollar threshold for R&D optimization value, not a price-over-time trend
-
When do AI agents outperform human research experts?
RE-Bench tests whether AI agents can match or exceed human ML researchers on open-ended engineering tasks across different time budgets, to understand at what scale each excels.
contrast: a fixed per-run cost comparison, not a price-decay-over-time pattern
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- The Price of Progress: Price Performance and the Future of AI
- The plunging price of thought
- The rising costs of training frontier AI models
- How persistent is the inference cost burden?
- How AI Can Degrade Human Performance in High-Stakes Settings
- Frontier AI capabilities can be run at home within a year or less
- AI and Scale: A Quantitative Task-Based Theory of Automation
- The Rise of Industrial AI in America: Microfoundations of the Productivity J-curve(s)
Original note title
Epoch AI finds AI performance prices fall fastest right after debuting as state of the art, then slow by half within two years