SYNTHESIS NOTE
Topics›Foundation Models›this note

Do compute costs really dominate AI company budgets?

Explores whether research and inference compute truly represent the largest expense category at major AI labs, and how this compares to staffing and other costs.

Synthesis note · 2026-10-16 · sourced from Foundation Models

Epoch AI's Luke Emberson and Yafah Edelman report that at the three AI companies where they can make estimates — Anthropic, Minimax and Z.ai — compute is the dominant expense: "R&D and inference compute together make up 54% to 62% of costs." Staffing, by contrast, is a comparatively small share: "Despite AI labs offering some of the highest salaries in tech, spending on staff accounts for less than 25% of total spending."

The authors categorize each company's spending into R&D compute, non-R&D (inference) compute, staffing, and other, expressed as a share of total operating expenses, including non-cash items like stock-based compensation — except for Anthropic, where staffing could not be separated out from the other categories. Their data sources differ by company: Anthropic's figures come from The Information's reporting of the company's "optimistic" projections as of December 2025 ($5.2B in EBITDA losses on $4.5B of revenue, implying $9.7B in total expenses; $4.1B of that spent on training, taken as R&D compute; a 40% gross margin implying $2.7B of inference compute against the $4.5B revenue). Minimax's and Z.ai's figures come from the detailed financial documents each company released for its January 2026 IPO.

This sits alongside Are AI agents now doing more research work than humans?, where a median daily agent inference cost above $600 is one visible symptom of the same compute-heavy cost structure Epoch AI finds at the balance-sheet level. It also contrasts with the buyer side captured in Are enterprises actually spending more on AI that works?: enterprises are moving AI spending into recurring IT budgets, while the labs selling them that compute carry the R&D and inference cost on their own books. And it sharpens the ambiguity in Why do individual AI gains not translate to business results? — if compute is this large a share of a lab's own costs, whether AI pays for itself depends as much on compute pricing and lab margins as on enterprise productivity gains. It also pairs with Do AI labs spend far more than they earn?, the companion finding from the same breakdown.

The estimate covers only three companies with unusual data availability — Anthropic via secondhand press reporting, Minimax and Z.ai via disclosures required for their IPOs — and Epoch AI flags its own Anthropic figures as "somewhat speculative" given that secondhand accounting. The breakdown says nothing about cost structure at labs that neither IPO nor have their financials leaked to the press, so this is a claim about three disclosed cases rather than a general law of AI-company economics, though the consistency of the pattern across three differently situated companies suggests compute dominance may generalize further than the sample alone can show.

Inquiring lines that read this note 26

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

What fundamentally drives AI inference pricing and cost decline patterns? What cost drivers and infrastructure choices characterize frontier AI training? How does offloading cognition to AI assistance affect learning retention? How does scaling test-time compute compare to increasing model size?

Related concepts in this collection 5

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
12 direct connections · 70 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

Epoch AI finds compute costs dominate spending at Anthropic, Minimax and Z.ai — R&D and inference compute make up 54% to 62% of costs