Can a seller infer what a buyer really wants to pay?
Does a buyer's natural shopping dialogue reveal their willingness to pay to a seller who reads only the conversation? An experiment tests whether verbal behavior patterns leak financial information without explicit numbers.
A controlled experiment in which a language-model buyer agent shops for wireless headphones on behalf of a described consumer finds that a seller-side inference agent reading only the dialogue transcript recovers the consumer's target willingness to pay (WTP) nearly one-for-one. Across six WTP levels ($50 to $500, N = 60 trials per cell), the OLS slope of inferred WTP on target WTP is 1.00 (bootstrap 95% CI [0.96, 1.05]) with Spearman rank correlation 1.00, when the buyer agent is given only a verbal consumer profile ("I'm a graduate student... and I'd rather not spend too much") with no dollar figure anywhere in the prompt. A contrasting numeric condition, where the agent instead receives a literal budget figure under an explicit instruction to keep it confidential, produces a slope of only 0.21 (CI [0.17, 0.26]) — the two intervals do not overlap.
The paper names this mechanism role coherence: when a model is asked to inhabit a consumer character grounded in occupation, life stage, and stated preferences, it generates questions, feature priorities, and price reactions that are coherent with that character — "asking about audiophile features is appropriate for the audiophile profile and inappropriate for the graduate-student profile" — not because of an external reward signal but because the agent is producing behavior consistent with the persona it was given. The authors show this signal is behavioral rather than a demographic-labeling artifact: stripping all financial vocabulary from the profile only drops the slope to 0.85, and stripping all identity cues from the transcript while preserving the shopping behavior itself leaves the slope at 0.93. A factorial replication across profile variants and prompt scaffolds returns a design-aware bootstrap CI of [0.93, 1.09] around the same slope of 1.00. The paper's framing is explicit that this is not an instruction-following failure or a guardrail bypass: "there is no number the consumer asked the agent to conceal... the information that reaches the seller is the information the consumer asked the agent to express."
This gives a concrete, measured mechanism for the privacy leg of the dynamic described in Does chatbot personalization build trust or expose privacy risks?: that note frames rising privacy concern as a byproduct of how much a model comes to know about a user, while this experiment shows the exposure can run the other direction too — the model's expression of what it already knows, filtered through its own role-consistent behavior, is itself legible to a third party (the seller) who was never granted access to the user's profile. It also sits alongside Does personalization make large language models worse at their jobs? as a second cost of giving a model rich personal context: that note documents degraded response quality from personalization, and this paper documents an economic cost — the same persona that lets an agent shop well is the substrate a counterparty can price against.
The experiment is a simulated two-agent dialogue over wireless headphones with six discrete WTP levels described in the excerpt; it does not establish how the slope would look with different product categories, real human sellers, longer negotiations, or production shopping agents operating under platform-level constraints. The excerpt also does not specify which model(s) played buyer and seller, limiting any claim about whether role coherence is a general LLM property or particular to the models tested. Within that scope, the finding supports a narrower but still consequential claim: for AI-mediated shopping as currently architected, giving an agent enough context to personalize is close to sufficient for a seller-side agent to re-derive the number the consumer never stated.
Inquiring lines that read this note 18
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What systematic biases emerge in AI shopping agents' decision-making?- How do different AI models weigh price signals versus product description text?
- What conflicts exist between vendor incentives and objective consumer research findings?
- Will merchants deliberately exploit stable position biases to influence agent purchasing?
- Which LLM models consistently win better deals as both buyer and seller?
- Does visible transaction history reduce or increase consumer anxiety about AI purchases?
- Can a merchant-paid agent be loyal to both the merchant and the user?
- Does capability advantage in negotiations persist across different product categories and deal types?
- Does preference articulation cost explain caution about full purchase delegation?
- Does stripping identity cues from shopping dialogue reduce seller inference accuracy?
- Can a buyer agent conceal willingness to pay while still shopping naturally in character?
- How much does removing financial vocabulary from a consumer profile weaken willingness to pay signals?
- How much willingness to pay can sellers infer from agent behavior alone?
- Why does personalization create a behavioral signature sellers can decode?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does chatbot personalization build trust or expose privacy risks?
Explores whether personalization features that increase user trust and social connection simultaneously heighten privacy concerns and create rising behavioral expectations over time.
gives a measured mechanism for the privacy-risk leg of that dual dynamic
-
Does personalization make large language models worse at their jobs?
Does conditioning LLMs on user context—profiles, history, preferences—introduce measurable harms alongside benefits? A 13-model study investigates whether personalization degrades factual accuracy, response diversity and objectivity.
a second cost of rich personal context, this time economic rather than qualitative
-
Can better prompts stop preference leakage in AI shopping?
Explores whether instruction-level fixes like privacy directives can prevent AI agents from revealing shopper preferences. This matters because it determines whether the problem is a guardrail failure or something deeper.
the sibling note on why this channel resists prompt-level fixes
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- When Agents Shop for You: Role Coherence in AI-Mediated Markets
- The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Markets
- Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer
- A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
- Advancing AI Negotiations: A Large-Scale Autonomous Negotiation Competition
- Using Large Language Models to Create AI Personas for Replication and Prediction of Media Effects: An Empirical Test of 133 Published Experimental Research Findings
- What Is Your AI Agent Buying? Evaluation, Biases, Model Dependence, & Emerging Implications for Agentic E-Commerce
- LLMs Reproduce Human Purchase Intent via Semantic Similarity Elicitation of Likert Ratings
Original note title
a verbal shopping persona lets sellers infer willingness to pay almost one-for-one, with no price ever stated