Do AI assistant brand mentions drive real user behavior?
When conversational AI names a brand to someone unfamiliar with it, does that mention actually change what the person searches for or visits online? The question matters because current analytics miss these upstream touchpoints entirely.
The paper measures what happens on the open web after a conversational assistant — ChatGPT, Claude, or Gemini — names a brand to a user who has no recent observed engagement with it. On an opt-in panel that joins pageview clickstream to the same users' chat conversations, "that user's same-name Google search rises +4.3 percentage points (pp) [3.1, 5.5], visits to the brand's own site +2.4 pp [1.4, 3.5], and brand-specific retailer-page visits +1.0 pp [0.3, 1.7] over matched backward placebos." The placebo is within-user: each outcome is differenced against the same user's rate over equal-width windows 14, 21, and 28 days earlier, so the comparison is a person against their own recent past rather than against other users. The panel has run in production at Scrunch AI since early 2026, and the paper reports a disclosure-safe aggregate of that deployed pipeline, excluding search-embedded surfaces like Google's AI Overviews because a "prompt" there is a search the user already typed.
The mechanism the paper gives for why this matters: last-click attribution and standard web analytics have no row for the assistant mentioned this brand, so none of this lift is visible to an advertiser's existing tooling. The naming event is upstream of the logged touchpoints (a Google search, a site visit, a retailer page) and gets credited to "organic" or "direct." The paper's own term for the mechanism is "acquisition-like reach": the effect concentrates among users with no recent observed brand engagement, while among already-engaged users a mention "coincides with an active episode without clearly accelerating it" — so the assistant's measurable role is bringing new people into the funnel, not speeding up people already in it. Three layered defenses rule out the obvious alternative explanation that the user was already going to search anyway: a pre-trend event study, a stance classifier (recommend / neutral / caution) that separates genuine recommendations from incidental references, and a same-category control showing the named brand moves far more than unnamed brands mentioned in the same response.
This sits alongside two neighboring notes on the same underlying phenomenon — assistants surfacing brands — from different angles. How consistent are AI brand recommendation lists across repeated prompts? measures whether a brand gets named at all and how stable that naming is; this paper measures what happens after a brand is named, to a specific user. Do AI search engines favor well-known brands over others? is similarly about citation rate rather than downstream user behavior. Do shopping agents respond more strongly to price and rating cues? and Does limiting product choices increase trust in voice assistants? both measure AI influence on a user's choice inside an agent-mediated session; this paper measures influence that plays out afterward, off-platform, on the open web, with no agent present at the moment of action.
The design is observational: the panel does not observe transactions, so the retailer-page visit is "purchase-adjacent," not a logged sale, and a reverse-causation scenario — a brand-specific intent shock that both triggers a recommendation and independently drives the user's search and visit, within the same session — "remains unidentifiable on observational data; a randomized or encouragement design would be needed to close it." The paper also does not claim this generalizes beyond the brand lexicon and two English-speaking markets it tested. What it does establish, carefully bounded, is that a brand named conversationally to an unengaged user is followed by more of that user's search, site, and retail activity than the same user's own recent baseline — a touchpoint that existing attribution models do not instrument.
Inquiring lines that read this note 5
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do AI-generated summaries affect traffic and engagement with original sources? Do AI shopping agents exhibit systematic bias in recommendations? How do chatbot properties shape user belief adoption and resistance? Does disclosing AI involvement change how audiences evaluate content trust?Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
How consistent are AI brand recommendation lists across repeated prompts?
Can AI tools like ChatGPT and Claude provide reliable, repeatable brand rankings for tracking market visibility? Understanding this matters because companies may be paying for AI tracking products based on metrics that don't actually measure what they claim.
measures whether a brand gets named at all; this paper measures what happens after it is named to a given user
-
Do AI search engines favor well-known brands over others?
Explores whether AI engines mention brands based on existing prominence rather than content quality or optimization. Matters because it suggests AI citation patterns may concentrate visibility among established players.
also measures AI brand-citation rate rather than the downstream user behavior this paper isolates
-
Do shopping agents respond more strongly to price and rating cues?
Explores whether AI agents manipulated by prices, ratings, and nudges shift their choices more dramatically than humans facing identical options. Matters because it affects how exploitable agents are to persuasion design.
measures AI influence on choice inside an agent session; this paper measures influence that surfaces afterward, off-platform
-
Does limiting product choices increase trust in voice assistants?
When shoppers evaluate fewer alternatives through a voice assistant, do they feel more satisfied and willing to let the assistant decide for them? This matters for understanding how AI systems gain authority over consumer decisions.
both concern AI-mediated shopping influence, but on session satisfaction rather than off-platform acquisition
-
Does pooling AI brand mentions mask the true recommendation effect?
When researchers count every AI brand mention as a recommendation, do they overstate the actual impact by mixing in existing customer behavior and incidental references? This matters for understanding whether AI really drives new customer acquisition.
Extends A: decomposes the naive pooled estimate's inflation into existing-customer pre-trends and incidental brand mentions
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- From Prompt to Purchase: How AI Brand Recommendations Move Consumers on the Open Web
- Generative Engine Optimization at Scale: Measuring Brand Visibility Across AI Search Engines
- The New Shape of Search: How Conversational AI Recomposes Information Seeking
- From Product Search to Preference Articulation: The Economics of Agentic Commerce
- Whom Do AI Agents Work For? Role Assignment Induces Sponsorship Bias in LLM Recommenders
- New Research: AIs are highly inconsistent when recommending brands or products
- How AI Is Changing Search Behaviors
- Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interest
Original note title
AI brand recommendations to non-customers raised same-name search 4.3pp, site visits 2.4pp, and retailer visits 1.0pp in a clickstream panel