AI shopping agents still show biased favorites based on list position, even with no pictures in the mix — just text.
Do AI shopping agents show consistent position bias in text-only interfaces?
This asks whether AI shopping agents keep favoring products by where they sit in a list even when nothing visual is shown to them, just plain text, and what that tells us about where the bias comes from.
This asks whether AI shopping agents keep favoring products by where they sit in a list even when nothing visual is shown to them, just plain text. The short answer is yes, but each model has its own pattern. The ACES study removed the visual storefront entirely and told agents outright to ignore product position. Strong position biases remained anyway, and each model had its own signature lean Do AI shopping agents show persistent position bias in text interfaces?. So the bias isn't a leftover from screen layout, the way a human's eye drifts to the top of a page. It belongs to the model itself. It also can come back after each model update. A seller can't tune against it once and move on, because the target keeps shifting.
The pattern fits a wider picture of how these agents make choices. When researchers gave 17 models and a group of humans the same binary product choices, the agents shifted their picks far more sharply in response to price, rating, and nudge changes. People made modest, probabilistic adjustments. The agents collapsed into near-rule-like behavior Do shopping agents respond more strongly to price and rating cues?. Position bias looks like one more case of the same thing: a small, irrelevant cue turned into a decisive one. Another paper suggests where these habits come from. LLM agents reproduce human-style decision biases without having the attention or memory limits that cause those biases in people. That points to patterns learned from training data and reward signals, not shared cognitive constraints Where do LLM choice biases actually come from?. In other words, the models may have learned "first is best" from us, without needing our reasons for it.
Why doesn't telling the agent to ignore position work? Research on persona prompts offers a parallel. Instructions change what a model says on the surface, but group-level bias underneath stays the same Can persona prompts actually reduce bias in language models?. Prompting works at the output level, and position preference seems to sit deeper. One proposed fix works through training instead of instructions: teach models to give the same answer whether or not a prompt contains irrelevant variations, using their own clean responses as the target Can models learn to ignore irrelevant prompt changes?. That's a plausible route for teaching agents to treat list order as noise, though the corpus doesn't show it being tested on shopping agents.
The less obvious point is that agent biases depend on the setup around them. A study of eight commercial LLMs found agents resisted marketing manipulation when every product detail was visible. They fell back on simple price-based shortcuts only when looking up attributes was costly and the user's goal was vague When do pricing cues actually mislead AI shopping agents?. That raises a fair question: is position bias also worse when agents can't cheaply compare everything? The corpus doesn't answer that yet. Humans have a version of the same problem. Eye-tracking shows AI Overviews now take the top-of-page attention that once went to the first search result Where do searchers look when AI Overviews appear?. Whether the shopper is a person or an agent, the top spot is worth a lot, and agent shoppers now give sellers a new and model-specific top spot to compete for.
Sources 7 notes
ACES found that AI agents exhibit strong, model-specific position biases even in headless text-only interfaces with explicit instructions to ignore position. The bias is a deep-seated model characteristic, not a superficial visual artifact, and recurs after each model update.
A benchmark testing 17 LLM models against humans on binary product choices found agents exhibited much larger choice shifts in response to price, rating, and nudge interventions—collapsing into rule-like patterns rather than the modest probabilistic shifts humans showed.
LLM agents reproduce human-like decision biases without the attention or memory constraints that cause them in people. The paper argues this points to learned patterns from training and reward signals rather than shared structural reasoning constraints.
Across three models, persona conditioning makes models follow trait instructions but fails to eliminate underlying bias. Between-group sentiment gaps persist unchanged, showing prompts operate only at the output level.
Two methods—BCT (output-level) and ACT (activation-level)—train models to respond identically to clean and wrapped prompts by using the model's own clean responses as targets, eliminating specification and capability staleness inherent in standard SFT.
Show all 7 sources
Eight commercial LLMs avoided marketing manipulation when all product details were visible, but fell into price-focused heuristics when attribute lookup was expensive and user goals were vague. The failure was in information retrieval, not reasoning or arithmetic.
Eye-tracking data shows AI Overviews receive significantly longer fixation times, reducing attention to the first-ranked result from 31% to 9%. Trust ratings between AI Overviews and ranked results remained equally high despite this attention shift.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
- Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer
- What Is Your AI Agent Buying? Evaluation, Biases, Model Dependence, & Emerging Implications for Agentic E-Commerce
- When Agents Shop for You: Role Coherence in AI-Mediated Markets
- From Product Search to Preference Articulation: The Economics of Agentic Commerce
- The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Markets
- The AI Agent in the Room: Rethinking Consumer Decision-Making in the Age of Autonomous AI
- The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs