Do compute costs really dominate AI company budgets?
Explores whether research and inference compute truly represent the largest expense category at major AI labs, and how this compares to staffing and other costs.
Epoch AI's Luke Emberson and Yafah Edelman report that at the three AI companies where they can make estimates — Anthropic, Minimax and Z.ai — compute is the dominant expense: "R&D and inference compute together make up 54% to 62% of costs." Staffing, by contrast, is a comparatively small share: "Despite AI labs offering some of the highest salaries in tech, spending on staff accounts for less than 25% of total spending."
The authors categorize each company's spending into R&D compute, non-R&D (inference) compute, staffing, and other, expressed as a share of total operating expenses, including non-cash items like stock-based compensation — except for Anthropic, where staffing could not be separated out from the other categories. Their data sources differ by company: Anthropic's figures come from The Information's reporting of the company's "optimistic" projections as of December 2025 ($5.2B in EBITDA losses on $4.5B of revenue, implying $9.7B in total expenses; $4.1B of that spent on training, taken as R&D compute; a 40% gross margin implying $2.7B of inference compute against the $4.5B revenue). Minimax's and Z.ai's figures come from the detailed financial documents each company released for its January 2026 IPO.
This sits alongside Are AI agents now doing more research work than humans?, where a median daily agent inference cost above $600 is one visible symptom of the same compute-heavy cost structure Epoch AI finds at the balance-sheet level. It also contrasts with the buyer side captured in Are enterprises actually spending more on AI that works?: enterprises are moving AI spending into recurring IT budgets, while the labs selling them that compute carry the R&D and inference cost on their own books. And it sharpens the ambiguity in Why do individual AI gains not translate to business results? — if compute is this large a share of a lab's own costs, whether AI pays for itself depends as much on compute pricing and lab margins as on enterprise productivity gains. It also pairs with Do AI labs spend far more than they earn?, the companion finding from the same breakdown.
The estimate covers only three companies with unusual data availability — Anthropic via secondhand press reporting, Minimax and Z.ai via disclosures required for their IPOs — and Epoch AI flags its own Anthropic figures as "somewhat speculative" given that secondhand accounting. The breakdown says nothing about cost structure at labs that neither IPO nor have their financials leaked to the press, so this is a claim about three disclosed cases rather than a general law of AI-company economics, though the consistency of the pattern across three differently situated companies suggests compute dominance may generalize further than the sample alone can show.
Inquiring lines that read this note 26
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What fundamentally drives AI inference pricing and cost decline patterns?- Does annualized capex or operating expense drive inference pricing?
- What margin do cloud providers add on top of infrastructure costs?
- How are enterprises shifting their spending on AI capabilities?
- Do R&D labor costs scale with computing power the same way hardware costs do?
- Does competitive pricing pressure explain most AI cost decline patterns?
- How much do typical users actually save from declining AI inference costs?
- Does real world AI cost drop as fast as benchmark performance prices?
- How do gross margins and operating margins differ for AI model providers?
- Do data collection costs erode the value of AI training investments?
- What efficiency gains could slow the growth in AI training costs?
- Why do enterprise AI deployments not reduce customer costs?
- Will enterprise AI budgets continue growing despite lab losses?
- How much of AI capability gains come from spending versus algorithmic efficiency?
- Does building inference infrastructure differ economically from building AI applications?
- Could AI inference capacity become scarcer than electricity for data centers?
- How much does electricity actually cost in a large AI data center?
- Why do AI labs lose more money than they earn from revenue?
- How much of frontier AI cost growth comes from chips versus skilled staff?
- What data-center infrastructure costs are excluded from frontier model training estimates?
- Why do AI labs face shorter repayment windows than traditional software companies?
- Which spending categories drive the rising cost of frontier AI training?
- What timeline do AI labs need to recoup model development costs before obsolescence?
- How much of frontier AI training costs come from staff versus hardware?
- Why are Anthropic and other labs spending far more than their revenue?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Are AI agents now doing more research work than humans?
OpenAI reports that its research agents are logging 3.1 workdays of effort for every 8 human hours, crossing the threshold where machines contribute more labor than people. This raises questions about what this shift means for research pace and autonomy.
its median daily agent inference cost is the same compute-heavy cost structure showing up at the usage level
-
Are enterprises actually spending more on AI that works?
As AI budgets move from experimental funds into core IT line items, are companies seeing measurable business returns? This matters because budget normalization could signal genuine value—or just shifting accounting categories.
the buyer-side counterpart: enterprises budget for AI while labs carry the compute cost on their books
-
Why do individual AI gains not translate to business results?
McKinsey's 2026 survey reveals 80 percent of workers report personal AI productivity gains, yet only 37 percent see enterprise EBIT improve. What explains this persistent gap between individual and organizational payoff?
whether AI pays for itself depends on lab compute costs as much as enterprise productivity gains
-
Do AI labs spend far more than they earn?
Epoch AI examined whether leading AI companies operate at massive losses relative to revenue. This matters because it determines whether the current AI business model is sustainable or requires fundamental changes.
companion finding from the same cost breakdown
-
How much do AI staff costs drive frontier model training?
Frontier AI models require massive spending on both chips and skilled R&D labor. Understanding the breakdown between hardware and human costs helps clarify what makes cutting-edge AI development so expensive.
Qualifies: Epoch AI's frontier training-run breakdown finds staff costs span 29-49%, far above A's under-25% company-wide staffing share
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Compute accounts for the majority of expenses of AI companies
- The rising costs of training frontier AI models
- Most of OpenAI's 2024 compute went to experiments
- The plunging price of thought
- The Price of Progress: Price Performance and the Future of AI
- State of AI Report 2026
- AI Compute Architecture and Evolution Trends
- RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
Original note title
Epoch AI finds compute costs dominate spending at Anthropic, Minimax and Z.ai — R&D and inference compute make up 54% to 62% of costs