When do pricing cues actually mislead AI shopping agents?
Do misleading retail pricing tactics work on AI agents because of inherent model flaws, or do they exploit specific weaknesses in task design and user instructions? Understanding the conditions matters for building trustworthy AI shoppers.
A paper testing eight commercially deployed LLMs across three providers as "surrogate consumers" finds that classic retail pricing cues — just-below pricing and promotional discount framing — rarely distort an AI shopping agent's choice when all product attributes are visible to it. The cues only become effective "when attribute acquisition was costly and the delegating goal was vague": under that combination, most of the tested LLMs "omitted diagnostic attributes, and the resulting choices resembled human heuristic decisions." The paper states its own conclusion directly: "the efficacy of marketing cues in delegated AI shopping is governed by storefront information architecture combined with consumers' instructions, not necessarily immutable LLM characteristics."
The authors build "Tool-Lab," an adaptation of information-board process tracing that places each product attribute behind a costly tool call, so they can observe which attributes an agent retrieves before it commits to a purchase. They separate "diagnostic" attributes that feed the unit-price calculation (list price, whole dollars, cents, discount percentage, weight) from "non-diagnostic" ones (packaging, country of origin, calories), and treat any choice that departs from unit-price minimization as a heuristic, resource-conserving substitution — for example, swapping the normative unit-price objective for a simpler price-minimization objective. Goal specificity, drawn from goal-setting theory, is the second lever: a "specific goal prompt" that names the objective and the diagnostic attributes "largely preserves diagnostic search and choice optimality," while a vague prompt under the same acquisition cost does not. Validation studies locate the failure in acquisition rather than computation: with information states assigned exogenously, seven of eight LLMs chose the normatively correct option in 99.3% of partial-information sessions, and no LLM made an arithmetic error when asked to report unit values.
This reframes the know/act split in Why do LLM agents remember preferences but not act on them?: there, agents hold the right preference but fail to apply it; here, agents apply the right rule faithfully to whatever information they hold, but a costly-retrieval-plus-vague-prompt environment keeps the right information from reaching the choice step at all — a failure upstream of utilization. It also sits alongside Why do accurate predictions lead to poor decisions?: both locate the source of a suboptimal AI-mediated decision in how the task is structured and specified, not in a fixed defect of the model. And it inverts the delegation direction studied in Does using LLMs actually improve strategic decision making? — there a human uses an LLM as a strategic aid; here the LLM is itself the surrogate decision-maker — yet arrives at a similar lesson, that instructions and environment shape outcome quality as much as native model competence.
The paper is candid about what its reasoning-trace evidence does not show: traces are "verbal reports of how an LLM describes its task, not direct measures of the neural network activations that produce its behavior," so the study documents what an agent acquired and which objective it articulated without establishing the internal mechanism, and it cannot rule out rival explanations such as training-data regularities or planning limits. The finding is scoped to packaged-goods unit-price choices across the eight tested LLMs and the two prompt-cost conditions described, not to agentic purchasing generally. The implication the evidence supports is narrower than "AI agents are bad shoppers": storefront design (what is costly to retrieve) and prompt specificity (what counts as diagnostic) jointly determine whether human-pricing heuristics resurface in an AI surrogate — a lever retailers and consumers can each pull.
Inquiring lines that read this note 6
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What systematic biases emerge in AI shopping agents' decision-making?- Do AI shopping agents show consistent position bias in text-only interfaces?
- Do AI agents currently verify brand claims against reality at scale?
- How do different AI models weigh price signals versus product description text?
- What new vulnerabilities emerge when AI agents replace humans as purchasing decision makers?
- Can a buyer agent conceal willingness to pay while still shopping naturally in character?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Why do LLM agents remember preferences but not act on them?
Research using paired recall and behavioral tests explores why language models often retrieve user preferences correctly yet fail to apply them in actual responses, especially for health-related requests.
both separate acquisition/retrieval failures from utilization failures in delegated AI tasks
-
Why do accurate predictions lead to poor decisions?
Predictive models are built to fit data, not to optimize decision outcomes. This note explores when and why accurate forecasts fail to produce good choices.
both trace suboptimal AI-mediated decisions to task design rather than a fixed model defect
-
Does using LLMs actually improve strategic decision making?
An experiment tested whether LLM assistance changes how people think through strategic choices and whether those changes lead to better predictions. Understanding this matters because organizations increasingly rely on AI to augment human decision-making.
studies the same delegation relationship from the human-user side rather than the AI-as-surrogate side
-
Does higher purchase volume make AI shoppers search less carefully?
When a shopping agent faces a larger order, does the stakes motivate more thorough information gathering, or does it paradoxically trigger shortcuts? This matters because it reveals whether vague goals create hidden risks in delegated AI decisions.
sibling finding from the same paper's volume-manipulation validation study
-
Where do LLM choice biases actually come from?
LLM agents show human-like susceptibility to nudges, price, and rating manipulation, but lack the cognitive constraints that explain human bias. What mechanisms drive this similarity if not bounded rationality?
Contradicts A: B attributes shopping-agent nudge susceptibility to training data and reward signals, not situational prompt factors
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer
- A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
- When Agents Shop for You: Role Coherence in AI-Mediated Markets
- The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Markets
- What Is Your AI Agent Buying? Evaluation, Biases, Model Dependence, & Emerging Implications for Agentic E-Commerce
- From Product Search to Preference Articulation: The Economics of Agentic Commerce
- The plunging price of thought
- The AI Agent in the Room: Rethinking Consumer Decision-Making in the Age of Autonomous AI
Original note title
information acquisition cost combined with vague goal prompts produces heuristic-like choices in AI shopping agents — not immutable LLM traits