How fast is AI capability becoming cheaper to produce?
Epoch AI tracked whether the cost of achieving fixed AI performance levels is falling, and if so, how that decline compares to other transformative technologies throughout history.
Epoch AI (Luke Emberson, David Roodman) estimate that "the cost of achieving a given level of AI performance has fallen about 47% per quarter since 2023, or 13× per year" — a decline they describe as faster than any other transformative technology in history, "four times faster than DNA sequencing, six times faster than compute, 18 times faster than lithium batteries, and (in the century up to 1973) 54 times faster than electricity." The rate varies by domain: "slower on game-based puzzles, at 39–43% per quarter," and "faster on math problems, at 50–52% per quarter." Their starkest illustration: OpenAI's o3, released January 31, 2025, scored 75% on GPQA Diamond (a PhD-level physics, chemistry, and biology exam) for an estimated 30 cents per question; "just under 18 months later," GPT-5.6 Luna matched that score for $0.0004 per question — "a 725-fold drop in the price of thought," which the authors compare to "the sticker price on a new car falling from $50,000 to $69."
Epoch AI's method tracks "the absolute cheapest model capable of any given level of performance" across five primary capability benchmarks (including Chess Puzzles, Mystery Game Puzzles, and FrontierMath tiers 1–3), rather than tracking any single model's price over time. Coarser evidence, they write, suggests the same pace of decline reaches back "to the dawn of commercial LLM inference in November 2021, when OpenAI fully released GPT-3." They set the finding against a macroeconomic backdrop in which "the AI boom is a macroeconomic force powerful enough to raise prices for the inputs it demands: chips, power, even the labor of electricians" — even as the price of the output those inputs produce falls sharply.
This prices AI capability in dollars at a different layer than How much progress have AI agents actually made on NanoGPT? and When do AI agents outperform human research experts?, which price an agent's R&D contribution against a human baseline rather than tracking how inference serving cost for a fixed benchmark score falls over calendar time; together the three give complementary dollar-denominated views of AI economics — serving cost (here), optimization value, and comparative task cost — without one superseding another. Do AI performance prices fall faster when capabilities debut? (sibling note) supplies the shape of this same decline curve that the 47%-per-quarter average flattens into a single number.
Epoch AI names its own caveats: "benchmaxxing" (deliberate training toward known benchmarks) could inflate benchmark gains relative to real-world task gains; the "frontier" measure assumes "an AI user who relentlessly searches for the most cost-effective model for each task," which real users don't do, so realized savings are likely smaller; and the dataset spans "barely three years" with incomplete model and benchmark coverage, so the authors say their bottom-line numbers "should not be read as exact." The finding establishes a rapid and historically unusual price decline for benchmark-measured AI performance; it does not establish that real-world AI costs for typical users fall at the same rate, nor that benchmark score gains track real-world usefulness at a fixed ratio.
Inquiring lines that read this note 6
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What fundamentally drives AI inference pricing and cost decline patterns?- What time horizon does the two-year performance price slowdown suggest?
- Does real world AI cost drop as fast as benchmark performance prices?
- Why do AI performance prices fall fastest right after reaching state of the art?
- How quickly will AI service costs fall enough to trigger widespread automation?
- Why does high-end benchmark performance decline in price faster than low-end?
Related concepts in this collection 6
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Do AI performance prices fall faster when capabilities debut?
Explores whether newly state-of-the-art AI capabilities command premium pricing that erodes over time, and how quickly that erosion happens across different benchmarks.
sibling note: supplies the two-speed shape behind this note's single average rate
-
How much progress have AI agents actually made on NanoGPT?
METR compares AI agent optimization to human researcher productivity on a popular benchmark. By measuring where their improvement curves intersect, they ask whether autonomous systems are meaningfully accelerating AI R&D or mostly chasing noise.
contrast: prices agentic R&D optimization as a one-time dollar threshold, not an inference serving price trend
-
When do AI agents outperform human research experts?
RE-Bench tests whether AI agents can match or exceed human ML researchers on open-ended engineering tasks across different time budgets, to understand at what scale each excels.
contrast: compares fixed per-run agent cost to human cost rather than tracking a price-over-time trend
-
Is benchmark progress outpacing the cost to achieve it?
While benchmark scores improve dramatically year over year, the computational cost of running frontier models is rising even faster. Does this mean progress is illusory, or driven by spending rather than genuine capability gains?
Extends: B adds that frontier running costs rise 3x-18x a year even as the same benchmark price-performance falls, as A finds
-
How fast are frontier AI training costs actually rising?
Researchers at Epoch AI estimated the rate at which the most expensive AI model training runs are becoming costlier. Understanding this trend matters because it shapes who can afford to build the most capable AI systems.
Qualifies: despite A's falling price-per-performance, B finds absolute frontier training costs still rising 2.4x yearly, toward a billion dollars by 2027
-
Does inference cost remain a persistent economic burden?
If inference costs fall 5–10x yearly as models improve and hardware advances, does the per-capability expense of deployment remain a structural problem, or does rapid cost reduction undermine that concern?
Extends: Denain applies the same falling cost-per-capability trend A reports to argue inference cost burdens from poor RL scaling aren't persistent
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- The plunging price of thought
- Rise of agentic AI: How trust is the key to human-AI collaboration
- The Price of Progress: Price Performance and the Future of AI
- How persistent is the inference cost burden?
- The rising costs of training frontier AI models
- State of AI Report 2026
- Frontier AI capabilities can be run at home within a year or less
- AI and Scale: A Quantitative Task-Based Theory of Automation
Original note title
Epoch AI estimates the price of AI performance has fallen about 47% per quarter since 2023 — faster than any other transformative technology