How much do AI staff costs drive frontier model training?
Frontier AI models require massive spending on both chips and skilled R&D labor. Understanding the breakdown between hardware and human costs helps clarify what makes cutting-edge AI development so expensive.
Breaking down the total amortized development cost of selected frontier models — GPT-3, OPT-175B, GPT-4, and Gemini Ultra — Epoch AI finds that "R&D staff are a major component, making up 29–49% of the total." For GPT-4 and Gemini, "the most significant expenses are AI accelerator chips and staff costs, each costing tens of millions of dollars." Other categories are smaller by comparison: "server components (15-22%), cluster-level interconnect (9-13%), and energy consumption (2-6%)." The paper adds that total frontier model development costs are "already over $100 million."
This breakdown comes from the same cost model behind the paper's 2.4× annual growth trend: hardware capital expenses (accelerator chips, servers, networking) amortized against depreciation, plus hardware energy consumption, with R&D staff costs added on top for the subset of models where enough detail was available to split staff out specifically. The paper flags the staff share as a finding that "motivates further research on the scaling of R&D labor with computing power" — it does not establish that staff costs scale with compute the way hardware costs do, only that they are large enough to matter.
This composition detail extends How fast are frontier AI training costs actually rising? by showing the growth trend is not purely a hardware story: labor is roughly a third to half of the bill. It also distinguishes this cost structure from the one in Does data really create lasting competitive advantage for startups?, where the rising cost is for acquiring additional training data rather than for the chips and people needed to run a training job — two different line items inside the broader claim that frontier AI is becoming more expensive to build.
The percentages come from only four named models, so the 29–49% staff range is a span across a handful of cases rather than a stable constant, and the paper treats the staff-to-compute relationship as an open question rather than a measured scaling law. As with the growth-rate estimate, the underlying method excludes data-center infrastructure beyond the training cluster and the cost of acquiring training data, so the true all-in cost of these models is likely understated rather than overstated.
Inquiring lines that read this note 8
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What cost drivers and infrastructure choices characterize frontier AI training?- Why did frontier training concentrate onto fewer chip designs after the V100?
- How long do leading AI chip designs stay in use for frontier training?
- What drives consolidation of frontier training onto specific hardware vendors?
- How much of frontier AI cost growth comes from chips versus skilled staff?
- Which spending categories drive the rising cost of frontier AI training?
- How much of frontier AI training costs come from staff versus hardware?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
How fast are frontier AI training costs actually rising?
Researchers at Epoch AI estimated the rate at which the most expensive AI model training runs are becoming costlier. Understanding this trend matters because it shapes who can afford to build the most capable AI systems.
the sibling note on the overall cost growth trend that this breakdown explains
-
Does data really create lasting competitive advantage for startups?
Explores whether proprietary datasets deliver the durable competitive moat that founders assume. A16z argues collection costs rise while marginal value falls, potentially reversing the flywheel effect.
contrasts a different line item in AI cost growth, data acquisition rather than chips and staff
-
Do compute costs really dominate AI company budgets?
Explores whether research and inference compute truly represent the largest expense category at major AI labs, and how this compares to staffing and other costs.
Qualifies: staff share falls below 25% of total company costs, versus 29-49% found in individual frontier training-run breakdowns
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- The rising costs of training frontier AI models
- Leading AI chip designs are used for around four years in frontier training
- Expenditure Horizon: Measuring Optimization Ability, with an Application to NanoGPT
- RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
- Research note: Evidence on AI R&D Progress from NanoGPT
- The plunging price of thought
- Compute accounts for the majority of expenses of AI companies
- PostTrainBench: Can LLM Agents Automate LLM Post-Training?
Original note title
Epoch AI finds AI chips and R&D staff dominate frontier AI training costs — staff make up 29 to 49 percent of the total