INQUIRING LINE

Companies keep running AI pilots, but most never see a dent in costs or revenue — why?

Why do most enterprise AI pilots show no measurable profit impact?

This explores why so many companies that try generative AI see no change in their profit and loss, and what separates the few that do.


This explores why most companies' AI experiments never show up in their revenue or costs, and what the small group that does see results is doing differently. The headline number comes from MIT NANDA: about 95% of enterprise generative AI pilots return no measurable profit impact, while roughly 5% extract millions Why do most enterprise AI pilots fail to deliver returns?. Other large surveys point the same way. PwC found that 56% of more than 4,000 CEOs saw neither lower costs nor higher revenue from AI in the past year Are CEOs actually seeing business gains from AI investments?. The surprising part is what explains the gap. It isn't which model a company picked. It's how the company deployed it: whether it bought tools or built them, whether line managers had real authority over the rollout, and whether the tools could adapt over time.

Part of the puzzle is that people really do feel more productive, and that feeling is easy to mistake for business results. McKinsey found that 80% of respondents report personal productivity gains, yet only 37% see enterprise-level earnings improve Why do individual AI gains not translate to business results?. A survey of 750 executives found the same pattern: perceived gains run ahead of measured ones, partly because revenue lags behind operational improvements Do AI productivity gains feel larger than they actually measure?. Some of the gain also disappears quietly. In a Zapier survey, 92% of users reported a productivity boost, but the average worker spends 4.5 hours a week fixing AI mistakes, and the heaviest, best-trained users spend the most time on cleanup How much time do workers really spend fixing AI mistakes?. Time saved at one step gets spent again at the next, so it never adds up to profit.

The companies that do see returns share a recognizable set of habits. McKinsey's roughly 6% of "AI high performers" redesign workflows instead of adding AI to the old process, keep humans validating AI output, manage costs, plan for workforce changes, and give senior leaders real ownership Why do individual AI gains not translate to business results?. In other words, profit shows up when the organization changes, not just when the tool arrives. There is also a skills caveat. AI productivity gains tend to appear when people apply skills they already have. When workers use AI to learn something new, the gains disappear and their learning suffers When does AI actually boost worker productivity?. A pilot that puts AI in front of people outside their expertise can fail even if the tool works well.

A less obvious reason is that the evidence used to pick and justify these tools may be measuring the wrong thing. An analysis of 960 real occupational workflows found that agents excel at benchmark-style contests but struggle with long, multi-step professional work Why do agent benchmarks not predict real economic value?. That means leaderboard scores can make pilots look ready when they aren't. Even so, companies aren't pulling back. a16z found that AI spending has moved out of experimental innovation budgets and into recurring core IT budgets, with leaders expecting about 75% growth Are enterprises actually spending more on AI that works?. So the real question is shifting from whether to spend on AI to whether companies will make the organizational changes that let the spending pay off. Those changes include redesigning workflows, deciding who owns the rollout, and measuring real work rather than contest scores.


Sources 8 notes

Why do most enterprise AI pilots fail to deliver returns?

MIT NANDA found that 95% of enterprise GenAI pilots return zero value while 5% extract millions. The difference tracks whether organizations buy versus build, empower line managers, and select tools that adapt over time—not model capability or regulation.

Are CEOs actually seeing business gains from AI investments?

PwC's survey of 4,000+ CEOs found 56% saw neither lower costs nor higher revenue from AI, with only 33% reporting revenue gains and 27% reporting cost savings in the past year. The data suggests AI adoption remains in early stages with benefit realization lagging behind implementation.

Why do individual AI gains not translate to business results?

McKinsey's 2026 survey of 1,719 respondents finds that while 80 percent report personal AI productivity gains, only 37 percent see enterprise EBIT improve. The 6 percent of "AI high performers" who do see measurable EBIT gains share common practices: workflow redesign, human validation in AI processes, cost management, strategic workforce planning, and strong senior leadership ownership.

Do AI productivity gains feel larger than they actually measure?

A survey of 750 executives found that perceived AI productivity gains exceed measured ones, likely because revenue lags operational improvements. Effects concentrate in high-skill services and finance, with labor reallocating rather than shrinking overall.

How much time do workers really spend fixing AI mistakes?

A Zapier survey of 1,100 enterprise AI users found 92% report productivity boosts, yet the average worker spends over half a day weekly revising AI-generated work. Trained, heavy users report the largest gains but also spend the most time on cleanup.

Show all 8 sources
When does AI actually boost worker productivity?

Studies showing AI productivity gains measured tasks within workers' existing domains. When workers used AI to learn new skills, productivity gains disappeared and learning suffered, suggesting prior findings do not generalize to skill acquisition.

Why do agent benchmarks not predict real economic value?

ALE's analysis of 960 real occupational workflows shows agents excel at abstract contests but fail long-horizon professional tasks. The gap is not model capability but benchmark design—the field optimizes what it measures, and it has measured contests rather than work.

Are enterprises actually spending more on AI that works?

a16z's 2025 survey found AI spending moved from experimental innovation funds (25% of budgets) to recurring core IT budgets (now 7% innovation). Leaders expect 75% budget growth next year, suggesting AI is treated as essential rather than experimental.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.