INQUIRING LINE

A traffic source 'growing 693%' sounds huge — but what if it started near zero and is still tiny?

How do headline growth percentages obscure small absolute changes in traffic?

This explores how a big percentage-growth headline, like a traffic source that 'grew 693%', can hide that the thing being measured is still tiny, and what readers should check before trusting such numbers.


This explores how a big growth percentage can make a small change sound huge, mostly in the current debate over how much web traffic AI sends or takes away. The clearest case in the corpus is Adobe's holiday 2025 report. It found that retail traffic referred by AI assistants grew 693.4% year over year, and that those visitors converted 31% better than other traffic How much traffic do AI assistants actually send to retailers?. The math is correct. But Lipsman checked it against Sensor Tower data and found that AI referrals went from about 0.1% to 0.6% of ecommerce traffic Does Adobe's AI referral traffic growth statistic hold up under scrutiny?. When you start from nearly zero, any growth looks explosive as a percentage. The useful question is not 'how fast did it grow?' but 'what share of the total is it now?' Half a percent is a real trend, but it is not yet a channel that changes a retailer's business.

The same issue works in reverse when traffic falls. You need to ask whether a drop is relative (a percentage of the old figure) or absolute (percentage points). Pew's browsing data shows people clicked a search result 8% of the time when Google showed an AI summary, versus 15% when it didn't Do AI summaries on Google reduce clicks to actual websites?. The headline says 'nearly half.' The absolute gap is 7 points of click rate. Both are accurate, but they feel very different. The randomized experiment by Agarwal and Sen reports a 39.8% relative cut in clicks to publishers Do AI Overviews actually reduce clicks to publisher sites?. Meanwhile, the Wikipedia natural experiment finds a modest 5.45% drop in search referrals to English Wikipedia Does AI search summaries divert traffic away from Wikipedia?. Publishers surveyed by the Reuters Institute expect a 40–43% decline over three years Will AI Overviews reduce search referral traffic to publishers?. That is a forecast, not a measurement, so it sits on a different level of evidence. Put these side by side and the 'AI is killing traffic' story turns out to range from about 5% to about 40%, depending on the site, the measurement method and whether the number is observed or predicted.

A second trap is when the headline and the data measure different things. Cloudflare's report is framed as 'non-human traffic now exceeds half of all internet activity.' Its key number, though, is that 52% of *crawler requests* are for AI training, up from 22% Is non-human traffic really half of all internet use?. A share of crawler traffic is not a share of all traffic. Before you trust a headline percentage, ask: a percentage of *what*?

The lesson goes beyond traffic statistics. Elsewhere in the corpus, the same pattern shows up in AI evaluation: a single summary number hides what matters underneath. Strong overall accuracy can hide confident wrong answers clustered in the rare cases where they cause harm Why do confident wrong answers hide in standard accuracy metrics?. Search answers can stay accurate while the sources behind them quietly collapse into synthetic content Does synthetic content in search results hide ecosystem decay?. Averaging a model's confidence across a whole reasoning chain can hide the single step where the reasoning broke Does step-level confidence outperform global averaging for trace filtering?. Growth rates, averages and aggregate accuracy all compress the data into one number, and each throws away the context you need to judge it. When you see a dramatic number, look for three things: the starting value, the absolute size, and what exactly is being counted.


Sources 10 notes

How much traffic do AI assistants actually send to retailers?

Adobe's 2025 holiday analytics found generative AI referrals to retail sites grew 693.4% year-over-year and converted 31% better than other traffic sources. AI shoppers spent 45% more time on-site, viewed 13% more pages, and reported higher purchase confidence and satisfaction.

Does Adobe's AI referral traffic growth statistic hold up under scrutiny?

Lipsman's analysis using Sensor Tower data shows Gen AI referral traffic rose from 0.1% to 0.6% of ecommerce traffic—a real but minuscule share. Adobe's 693.4% growth rate was mathematically valid but lacked crucial context about the near-zero baseline.

Do AI summaries on Google reduce clicks to actual websites?

Pew's analysis of 68,879 Google searches found users clicked search result links 8% of the time when an AI summary appeared, versus 15% without one. Sessions were also 10 percentage points more likely to end without any clicks.

Do AI Overviews actually reduce clicks to publisher sites?

A randomized field experiment with 1,000+ users found AI Overviews reduced organic clicks to third-party sites by 39.8% while providing no measurable improvement in click quality or user satisfaction.

Does AI search summaries divert traffic away from Wikipedia?

A natural experiment using Wikipedia's language editions found that Google's AI Overviews lowered search referrals to English Wikipedia by 5.45% versus German and 4.82% versus French controls. The effect appears driven by answer-layer intermediation that satisfies user queries before clicks reach the source.

Show all 10 sources
Will AI Overviews reduce search referral traffic to publishers?

A Reuters Institute survey of news executives found publishers expect Google search referrals to fall 40-43% over three years, driven by AI Overviews that answer queries in-place rather than directing clicks. Measured data shows search traffic to news sites has already begun declining, though the full magnitude remains unquantified.

Is non-human traffic really half of all internet use?

Cloudflare's network data shows 52% of crawler requests are for AI training as of June 2026, up from 22% in Spring 2025, with human traffic in heavily crawled categories declining as much as 40% in one year. Publishers increasingly turn to licensing deals rather than relying on search referral traffic.

Why do confident wrong answers hide in standard accuracy metrics?

Medical triage, legal interpretation, and financial planning show a consistent pattern: surface heuristics conflict with unstated constraints, producing fluent confident errors that concentrate in rare cases where harm occurs. Aggregate accuracy masks these failures because overall performance looks strong.

Does synthetic content in search results hide ecosystem decay?

When 67% of a corpus becomes synthetic, over 80% of retrieved results shift to synthetic sources while answer accuracy remains high, masking the loss of source diversity. This creates fragility: high accuracy resting on a monoculture collapses when that monoculture is poisoned.

Does step-level confidence outperform global averaging for trace filtering?

Local step-level confidence catches reasoning breakdowns that global averaging masks and enables early stopping before traces complete. This approach achieves comparable accuracy gains to naive majority voting with far fewer generated traces, proving trace quality matters more than quantity.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.