People tell surveys they trust AI agents, then quietly keep their hands on the wheel when it's time to actually click buy.
Why do survey measures of AI trust exceed actual delegation rates?
This explores why people say they trust AI agents in surveys but hand over less real control than those numbers suggest, and what makes the gap between saying and doing.
This explores why people say they trust AI agents in surveys but hand over less real control than those numbers suggest. One caveat first: the corpus has no study that puts stated trust and observed delegation side by side for the same people. What it does have, spread across several notes, is a fairly clear picture of why a 'yes, I'd trust it' answer doesn't turn into handing over the keys.
The first reason is that survey trust is abstract and delegation is specific. Accenture found 74% of consumers would trust an AI agent with purchases, but 56% would still pick the brand themselves, and many loyal shoppers wouldn't let the agent switch Do consumers actually want to delegate shopping decisions to AI?. So the 'yes' was really a conditional yes: the agent can do the errand, but I keep the decisions. The more concrete the question gets, the lower the number. Public First found 45% think AI will change the world, but only 29% would give an agent access to their bank account How willing are people to let AI control their finances?. A general attitude toward 'AI' gets measured differently from permission to touch one particular thing that matters.
The second reason is the most surprising. What makes people pull back isn't how high the stakes are. It's whether a mistake can be undone and whether other people will see it. In a controlled study, students lost trust sharply and demanded approval steps for actions like sending an email, even when they rated the agent's output as fine. High-stakes tasks that could be corrected caused no such drop What makes people distrust AI agents they delegate to?. A survey question rarely raises irreversibility or public exposure, but real delegation raises them right away. That may be most of the gap: people answer surveys as if every mistake can be fixed, and they delegate as if it can't.
Third, using an agent tends to wear trust down rather than build it. Capgemini found enterprise trust in fully autonomous agents fell from 43% to 27% in one year, as companies moved past pilots into real deployment Why is enterprise trust in autonomous AI agents declining?. KPMG's 47-country survey shows the same decline, and ties it partly to people's own bad experiences Why does AI trust keep falling even though it matters most?. The way back is feedback on outcomes. People who avoided a partner once it was revealed to be AI changed their minds only after repeatedly seeing its results Does revealing AI identity help or hurt user trust?. Shneiderman's framework explains why capability alone won't close the gap: reliability, safety and trust each come from different sources, and real trust depends on independent oversight, not just better performance Can we separate reliability, safety, and trust into distinct mechanisms?.
Here's the twist you might not expect: the gap also runs the other way. Among developers, 80% use AI tools while only 29% trust their accuracy Why do developers keep using AI tools they don't trust?. They delegate more than they trust, because they can check the output before it ships. Read together, these findings suggest that 'trust' isn't really the variable that decides delegation. Verifiability and reversibility are. People delegate freely when they can catch and undo errors, whatever they tell a survey, and hold back when they can't. A design lesson follows: an agent gets more real delegation by making its actions reviewable and reversible than by sounding more trustworthy. Sounding trustworthy is already a known trap, since trust tends to attach to how authoritative a chatbot sounds rather than to whether it's right Does chatbot language style actually shape how much we trust it?.
Sources 9 notes
Accenture's 25,590-person survey found 74% would trust an AI agent with purchases, yet 56% would specify brands and 37% of loyal consumers wouldn't switch. Delegation appetite depends on trust protections being in place first, not on capability alone.
A Public First survey of 18,000 people across 15 countries found that while 45% believe AI will significantly change the world, just 29% would grant an AI agent access to their bank account, revealing a distinct trust ceiling for financially sensitive delegation.
In a controlled study of 20 students using a general-purpose AI agent, tasks that were irreversible and externally visible (like sending email) produced sharp trust drops and approval demands even when output quality was rated adequate. High-stakes but correctable tasks showed no such effect.
Capgemini's survey of 1,500 leaders found trust in fully autonomous agents dropped from 43% to 27% in 12 months, signaling that initial enthusiasm is giving way to skepticism as deployment moves beyond pilots. Despite the decline, organizations still expect to deploy agents on human-supervised teams within three years.
A KPMG and University of Melbourne survey of 48,000 respondents across 47 countries found trust is the primary factor determining AI acceptance, yet perceived trustworthiness fell from 63% in 2022 to 56% in 2024, driven by widespread risk concerns and reported negative personal experiences.
Show all 9 sources
Users initially avoid AI partners when identity is revealed, but this preference reverses after repeated interactions with visible results. The learning mechanism—observing consistent outcomes—is essential; disclosure without feedback produces no calibration.
Shneiderman's RST framework splits AI trustworthiness into three separable prerequisites: reliability emerges from sound technical practices, safety from management culture, and trust from independent oversight structures. Each lever operates independently, so improving one does not automatically improve the others.
Stack Overflow's 2025 survey shows 80% of developers use AI tools while trust in accuracy fell from 40% to 29%. The primary complaint: AI code that looks correct but contains subtle errors, creating a verification burden that erodes confidence faster than usage grows.
Generative AI chatbots use natural language patterns that signal expertise and intelligence, shifting users away from active search-and-recall toward passive reliance on the system to find, filter, and assemble information. Trust attaches to the register of the answer rather than its accuracy.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- 2025 Stack Overflow Developer Survey: developers remain willing but reluctant to use AI
- Exploring automation bias in human-AI collaboration: a review and implications for explainable AI
- Trust, attitudes and use of artificial intelligence: A global study 2025
- Agentic Commerce: Why Do Shoppers Delegate Purchase Decisions to AI?
- LLM or Human? Perceptions of Trust and Information Quality in Research Summaries
- Humans learn to prefer trustworthy AI over human partners
- The Decision to Verify: How Warmth and User Characteristics Shape Reliance on Conversational Agents for Information Search