Total cost of ownership of a one-gigawatt AI data center
Source: Epoch AI (Amelia Michael, Ben Cottier) · 2026-05-14
A typical one-gigawatt AI data center requires $38 billion in up-front capital expenditure (CapEx) and $0.9 billion in annual operating expenses (OpEx). If CapEx is annualized over each asset’s lifespan, the total cost of ownership equates to $8.5 billion per year. Servers dominate this cost at $5 billion per year, or 60% of the total. Operating costs are small by comparison: even energy, the largest OpEx category, costs only $0.6 billion per year.
The annualization is sensitive to the IT equipment lifespan. We assume 5 years for IT equipment and 14 years for the facility. Shortening the IT lifespan to 3 years raises the total annual cost to $12B; extending it to 7 years lowers the cost to $7B.
We model the annual cost of a typical AI data center that is owned and operated by a US hyperscaler and has 1 GW of nameplate capacity for the IT equipment. This is a stylized model, not an estimate for any specific facility; actual costs will vary with server choice, facility design, location, financing, and power strategy.
The model builds on Amelia Michael’s earlier data center cost model. The main changes are scaling the facility from 100 MW to 1 GW of IT power (which is not totally linear), assuming all servers are NVIDIA GB200 NVL72 systems rather than DGX H100 systems, and updating selected cost inputs where newer estimates were available. The updated annual total cost of ownership is $8.5 million/MW, down from $10.8 million/MW.
Energy: Energy costs are a function of electricity prices and energy usage. Energy usage is in turn a function of IT power capacity, power usage effectiveness (PUE), and utilization rate. To estimate electricity costs, we weight EIA state-level industrial electrical costs in 2024 by data center project counts from Aterio, which gives 8.34 cents/kWh. IT power capacity is fixed at 1 GW. PUE is 1.14 based on estimates from Lawrence Berkeley Lab of AI-specialized data center energy usage (Figure 4.5). The utilization rate is 71% based on the average of four estimates collected by Tyler Norris.
Maintenance: Annual maintenance costs are based on a lifecycle estimate from A.CRE. We sense-check this estimate using public company filings that report repair and maintenance, facility management, and other facility operating costs [example, p.75].
Labor: Labor costs are a function of the number of employees and wages. The number of employees is based on an estimate from a BCG analysis, which is consistent with empirical values we found. Wages are based on Glassdoor figures.
Land: Land costs are a function of the number of acres and the per-acre cost. We estimate the number of acres by looking at the ratio of acres to MW for 18 large data centers where both acres and MW are reported [example]. We use an estimate from Cushman & Wakefield of the average cost of data center land in October 2024.
Tax costs include real property, tangible personal property, sales, and employer payroll taxes. Property tax assumptions use Lincoln Institute and Tax Foundation estimates, with tangible personal property and state unemployment taxes weighted by Aterio state project counts. Sales taxes are assumed to be 0 because most states exempt data center equipment, and property tax abatements are estimated from reported tax status for large data centers.
Water: Water costs are a function of water usage and water prices. Water usage is based on the Lawrence Berkeley Lab’s average water usage effectiveness estimate for AI-specialized data centers, and water prices use the EPA’s US average commercial water cost.
Servers and network infrastructure: Server and network infrastructure costs are a function of the number of servers and the cost per server. The number of servers is implied by IT power and the power density of a NVIDIA GB200 NVL72. Server and network infrastructure costs are based on public SemiAnalysis estimates. We approximate the non-server cluster capex as being all for networking.
Facility: Facility construction costs are based on Turner & Townsend’s data center construction cost index. We use a MW-weighted average across major US markets and include Turner & Townsend’s liquid-cooling cost premium of 7–10%.
Utility works (substations): Substation costs are a function of power requirements, transformer capacity, and the number of substations required. Assumptions on voltage and substation sizing are based on Dominion Energy; unit costs use MISO’s transmission cost guide.
Bandwidth (external cabling): Fiber cabling costs are a function of connection distance, cost per kilometer, and equipment costs. Distance is based on a power-plant distribution analysis as a proxy for inter-data center distance. Fiber costs use Cartesian’s US fiber deployment estimate. Equipment costs are based on retailer estimates and specs from Cisco.
Lifespans: Lifespans are used to annualize capital costs. Facility lifespans are based on data-center lifecycle estimates [example]; server and network lifespans are based on hyperscaler depreciation disclosures and estimates for AI hardware [example].
Discount rate: The discount rate is the weighted average cost of capital (WACC) for the computer services industry. It is used in the capital recovery factor (CRF) that annualizes capital costs, and to estimate the opportunity cost of land use.
To compare capital costs to operating costs, capital costs are annualized. Most capital expenses are converted into annual expenses by multiplying capital expenses by a capital recovery factor (CRF). The CRF depends on the lifetime of the capital and the discount rate. We assume different lifetimes for servers and facilities. Land is treated separately: because land does not depreciate like servers or buildings, we annualize it using the opportunity cost of the capital tied up in the land. The discount rate is the weighted average cost of capital (WACC). We estimate a server/networking CRF of 0.24 and a facilities CRF of 0.13.
Lines of inquiry this paper opens 24
Research framings built by reading the notes related to this paper — the questions it feeds into.
What fundamentally drives AI inference pricing and cost decline patterns?- How sensitive is data center cost to hardware depreciation assumptions?
- Does annualized capex or operating expense drive inference pricing?
- What margin do cloud providers add on top of infrastructure costs?
- How do different financing terms affect total cost of ownership?
- Do R&D labor costs scale with computing power the same way hardware costs do?
- Does competitive pricing pressure explain most AI cost decline patterns?
- How much do typical users actually save from declining AI inference costs?
- Does real world AI cost drop as fast as benchmark performance prices?
- Why do AI performance prices fall fastest right after reaching state of the art?
- How are hyperscalers adjusting capex budgets in response to memory cost inflation?
- What is driving the price increase in high-bandwidth memory supplies?
- Will memory's share of chip costs continue rising through 2026?
- How do gross margins and operating margins differ for AI model providers?
- Do data collection costs erode the value of AI training investments?
- What efficiency gains could slow the growth in AI training costs?
- Why do enterprise AI deployments not reduce customer costs?
- How is Meta's internal token usage driving AI infrastructure decisions?
- Can customers value AI deployment while developers still lose money on it?
- Why do AI labs lose more money than they earn from revenue?
- How much of frontier AI cost growth comes from chips versus skilled staff?
- What data-center infrastructure costs are excluded from frontier model training estimates?
- Which spending categories drive the rising cost of frontier AI training?
- What timeline do AI labs need to recoup model development costs before obsolescence?