INQUIRING LINE

Could an AI's praise for a brand and your own sudden urge to buy it show up at the very same moment?

Can a brand-specific intent shock occur in the same session as a recommendation?

This explores whether a person's sudden interest in a specific brand can show up in the same AI chat session where the AI recommends that brand, which would make it hard to tell whether the recommendation caused the interest or just happened alongside it.


This explores whether a sudden interest in a particular brand can arise in the same chat session where an AI assistant recommends it. If it can, a later brand search might look like the recommendation's effect when it was really the person's own interest. Yes, it can. This is one of the main reasons that measuring what AI recommendations actually do is harder than it looks. The most direct evidence in the collection is a clickstream panel study. It found that pooling every AI mention of a brand roughly doubles the apparent effect of recommendations Does pooling AI brand mentions mask the true recommendation effect?. Much of that inflation came from things that were already happening: brand trends that started before the chat, and existing customers acting as they normally would. Many people ask an AI about a brand because they are already heading toward it, so the mention follows their intent rather than creating it.

The researchers' fix was to look only at non-customers and to separate real recommendations from incidental mentions. After that correction, the effect shrank to about +4.3 percentage points for same-name search, +2.4 for site visits and +1.0 for retailer visits. Those are still real effects, just smaller. Notice what this fix can and can't catch. Excluding existing customers removes long-standing intent. It does not obviously remove intent that appears mid-session, for example when someone sees an ad, hears a friend mention the brand, or types the brand name into their own prompt. The collection doesn't describe how, or whether, this kind of same-session shock is separated out. That gap is worth noticing when you read headline numbers about AI-driven traffic.

Other parts of the collection show why the direction of cause is so slippery. Recommender research increasingly treats what users say during a session as something the system should follow. Mender, for example, lets people steer recommendations by stating their preferences in plain language as they go Can users steer recommendations with natural language at inference?. A field study of LLM movie recommenders likewise found that context users provided mattered more than clever prompting Do LLM movie recommenders actually personalize to individual users?. This is good design. It also means that in a conversational assistant, the user's intent often shapes the recommendation, not the reverse. When a brand name in the prompt produces a recommendation of that brand, the recommendation partly reflects the user's own intent back to them.

There is also a measurement point underneath this. Clicks, purchases and searches carry two signals at once: how much someone prefers something, and how confident we can be in reading that preference Can implicit feedback reveal both preference and confidence?. A brand search right after an AI chat is high-confidence behavior, but it can't tell you whether the preference came before the chat or from it. Framing adds a further complication: LLM recommendations can shift with small things like the order of options in a prompt Do LLMs consistently favor the same strategic choices regardless of context?. So how a user words a question that already carries intent can tilt what gets recommended.

In short: same-session intent shocks are plausible, and they push estimates of AI's persuasive power upward. The collection has one study that removes the biggest sources of this bias. It doesn't yet have work that separates interest arising inside a session from the recommendation itself.


Sources 5 notes

Does pooling AI brand mentions mask the true recommendation effect?

The paper shows that naive pooled estimates (+2.08/+2.37/+0.52 pp) roughly double the true acquisition effect (+4.3/+2.4/+1.0 pp) when controlling for existing customers and incidental mentions. The inflation comes from pre-existing trends and ordinary repeat-customer behavior.

Can users steer recommendations with natural language at inference?

Mender conditions sequential recommenders on natural-language preferences extracted from reviews, enabling users to steer recommendations at inference without fine-tuning. This approach succeeds on preference-following tasks where traditional recommenders fail because preferences are runtime inputs, not training targets.

Do LLM movie recommenders actually personalize to individual users?

A 160-user field study found LLMs deliver strong explainability yet lack personalization, diversity, and user trust. User-provided context matters more than prompt engineering, and LLMs perform better on niche items than mainstream ones.

Can implicit feedback reveal both preference and confidence?

Hu, Koren, and Volinsky show that implicit signals (watches, purchases, clicks) encode preference and confidence as two distinct dimensions. Explicit ratings collapse these into one number, losing information about certainty in the preference estimate.

Do LLMs consistently favor the same strategic choices regardless of context?

Across 15,000 simulations, six LLMs recommended the same strategic choice in every tension tested. Industry context shifted bias only 11%, while option order—a framing artifact—shifted results 19%, revealing that models recombine trend-coded vocabulary rather than analyze context.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.