People say they trust AI shopping agents, but do they actually grasp what these agents can't do?
Do consumers who trust AI agents understand their actual limitations?
This explores whether the people who say they trust AI agents with shopping, money, and errands have an accurate picture of what those agents can and can't do, or whether their trust rests on something else.
This explores whether consumer trust in AI agents is based on an accurate sense of what the agents can do. The short answer from the corpus is that no study here directly tests what consumers know about agent limitations. What the corpus does show is that trust appears to run on signals other than an understanding of limits. Surveys report striking headline numbers. Accenture found 74% of people would trust an AI agent with purchases Do consumers actually want to delegate shopping decisions to AI?, and RTB House found 39% of U.S. shoppers say AI understands their needs better than friends and family. RTB House also found a 'super-truster' segment willing to let AI buy without return protections How much do shoppers trust AI shopping assistants?. Yet the same Accenture respondents mostly still want to name the brands themselves. In a 15-country survey, only 29% would give an agent access to their bank account How willing are people to let AI control their finances?. So trust is high in general but limited in practice. People hold a vague belief that the agent is helpful and draw hard lines around their money and brand choices.
Where do those lines come from? One controlled study gives a clue. People pulled back their trust when a task was irreversible and visible to others, like sending an email. They did not pull back when a task was merely high-stakes, and this held even when they rated the agent's output as fine What makes people distrust AI agents they delegate to?. That suggests people judge how bad a mistake would be and whether it could be undone, not how likely the agent is to make one. Studies of adoption point the same way. Shoppers accept highly autonomous assistants because of the benefits they expect, such as saving time when stock is scarce, not because they've assessed the agent's reliability What drives shoppers to accept autonomous AI assistants?.
The less obvious problem is that some of the most important limitations would be hard for consumers to see even if they looked. Capability claims are themselves unreliable. Agents that win benchmark contests still fail at long, real-world professional tasks Why do agent benchmarks not predict real economic value?. Historically, agents have also failed because the surrounding ecosystem wasn't ready, not because the technology fell short Why do capable AI agents still fail in real deployments?. Other limits come from who pays for the agent rather than from the technology. An agent funded by merchant referral fees can't be fully loyal to both the shopper and the merchant Can an AI agent serve both merchant and user interests fairly?. Notably, consumers in Accenture's survey say they *prefer* agents built by retailers, which are exactly the setups where that conflict is built in Will brands succeed by building their own AI shopping agents?.
There is a deeper twist. Agents that execute purchases may help shape what the consumer wants in the first place. Through repeated conversations, the agent learns from the user and the user's trust grows, and preferences form inside that loop Do AI shopping agents reshape what consumers actually want?. If so, a consumer can't easily judge whether the agent served their preferences, because the agent helped create them. The most hopeful finding is that trust can become accurate, but only with feedback. When users can repeatedly see outcomes, their reactions to AI shift from initial bias toward judgment based on results. Simply telling them it's an AI does nothing on its own Does revealing AI identity help or hurt user trust?. The takeaway is that understanding of limits doesn't come with trust. It has to be built through visible, checkable results, and much of today's agent commerce, especially autonomous purchases and merchant-funded recommendations, doesn't yet provide them.
Sources 11 notes
Accenture's 25,590-person survey found 74% would trust an AI agent with purchases, yet 56% would specify brands and 37% of loyal consumers wouldn't switch. Delegation appetite depends on trust protections being in place first, not on capability alone.
RTB House's survey found 39% of U.S. shoppers say AI understands their needs better than friends and family, and AI outranks newspapers and social media on trust. A minority segment called 'super-trusters' would allow AI to purchase autonomously without return protections.
A Public First survey of 18,000 people across 15 countries found that while 45% believe AI will significantly change the world, just 29% would grant an AI agent access to their bank account, revealing a distinct trust ceiling for financially sensitive delegation.
In a controlled study of 20 students using a general-purpose AI agent, tasks that were irreversible and externally visible (like sending email) produced sharp trust drops and approval demands even when output quality was rated adequate. High-stakes but correctable tasks showed no such effect.
Five studies including real ad click-through data show that perceived benefits, not personal sense of power, drive consumer adoption of high-autonomy AI shopping assistants—especially when scarcity amplifies the assistant's value.
Show all 11 sources
ALE's analysis of 960 real occupational workflows shows agents excel at abstract contests but fail long-horizon professional tasks. The gap is not model capability but benchmark design—the field optimizes what it measures, and it has measured contests rather than work.
Historical analysis from GPS to modern AI shows agent failures consistently result from absent ecosystem conditions—value generation, personalization, trustworthiness, social acceptability, and standardization—rather than capability gaps. Even highly capable systems stall without these five conditions.
Azhar argues that agents like Meta's Muse, which earn referral fees from merchants like Expedia, face structural conflicts that prevent unbiased recommendations. The incentive to collect fees, not technology, determines which platforms build or block such agents.
Accenture reports 71% of consumers expect AI agents to influence half their spending within 12 months and prefer retailer-built agents. However, the evidence reflects consumer preferences in surveys rather than demonstrated agent capability or functioning comparison infrastructure at scale.
Bilgihan and colleagues argue that transactional AI agents—which execute purchases rather than just recommend—end the consumer's sole cognitive role in preference formation. Preferences emerge through bidirectional feedback loops between agent learning and consumer trust, not independently beforehand.
Users initially avoid AI partners when identity is revealed, but this preference reverses after repeated interactions with visible results. The learning mechanism—observing consistent outcomes—is essential; disclosure without feedback produces no calibration.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- From Product Search to Preference Articulation: The Economics of Agentic Commerce
- Agentic Commerce: Why Do Shoppers Delegate Purchase Decisions to AI?
- Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer
- Consumer Pulse Research 2026: Talk to my AI agent
- What Is Your AI Agent Buying? Evaluation, Biases, Model Dependence, & Emerging Implications for Agentic E-Commerce
- When Agents Shop for You: Role Coherence in AI-Mediated Markets
- A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
- The AI Agent in the Room: Rethinking Consumer Decision-Making in the Age of Autonomous AI