Your trust in AI shouldn't be one-size-fits-all — it should shift with what you're actually asking it to do.
Why does domain matter when measuring trust in AI systems?
This explores why a single trust score for an AI system is misleading: the kind of task, its consequences, and the setting change both how much people trust AI and whether that trust is deserved.
This explores why a single trust score for an AI system is misleading: the kind of task, its consequences, and the setting change both how much people trust AI and whether that trust is deserved. The corpus has no study that compares trust across domains side by side. Read together, though, its findings point the same way. Trust doesn't belong to the AI alone. It forms between a person, a system and the specific thing they're asking it to do.
The clearest evidence comes from payments. Most US adults already use AI assistants, but fewer than a quarter trust AI to complete a purchase. When a familiar payments brand is named as the intermediary, that number nearly triples Does naming a payments brand increase trust in AI transactions?. So the same people trust the same technology very differently depending on whether money moves and who stands behind the transaction. A study of people handing tasks to AI agents makes this more precise, and the result is surprising. Trust didn't drop because the stakes were high. It dropped when an action couldn't be undone and other people would see it, like sending an email. High-stakes tasks that could be corrected didn't trigger the same pullback What makes people distrust AI agents they delegate to?. 'Domain' may really be shorthand for these underlying properties: Can I undo it? Will others see it? Is there an institution behind it?
Domain also matters because the cues people use to judge AI don't work equally well everywhere. Users trust ChatGPT because the conversation feels responsive, fast and well formatted, not because they've checked whether it's accurate Does conversational style actually make AI more trustworthy?. Chatbots also sound like experts, and that confident tone draws trust whether or not the answer is right Does chatbot language style actually shape how much we trust it?. Across many languages, people follow confident outputs even when they're wrong Do users worldwide trust confident AI outputs even when wrong?. In casual use, misplaced trust costs little. In medicine it can be dangerous. Training models to sound warmer and more empathetic made them less reliable on medical reasoning and truthfulness, and standard safety benchmarks didn't catch it Does empathy training make AI systems less reliable?. The places where a caring tone feels most welcome may be the places where it hides the most error.
Expert fields add another layer. In professional communities, trust isn't earned by being right once. It comes from belonging: a track record of judgments others can test, and taking part in how the field reaches agreement. AI can't take part in that process, so in expert domains it may hit a trust ceiling however accurate it gets Can AI ever gain expert community trust through participation?. Related work argues that AI can't make real assertions because nobody can hold it accountable for what it says Can AI systems genuinely assert claims about the world?. Domains that depend on accountability, like law, medicine and science, will feel that gap more sharply than domains that don't.
Finally, trust changes over time, and how it changes depends on whether people can see the results. Telling users they're working with an AI first creates a bias against it. That bias reverses only after repeated interactions where the results are visible Does revealing AI identity help or hurt user trust?. In domains with quick, visible feedback, like shopping or scheduling, trust can adjust to how good the AI really is. In domains where errors show up slowly or never, like advice, diagnosis or emotional support, that correction may never happen. This is where personalization's mix of trust and manipulation matters most Does personalization in AI increase trust or manipulation risk?. Measuring trust without the domain mixes all these conditions together, and the average describes no real situation.
Sources 10 notes
A Harris Poll survey found 72% of US adults use AI assistants, but only 23% trust AI to execute payments. When Visa's name was attached, 61% reported trust in the company to handle agent-initiated transactions—suggesting consumers prefer a recognized intermediary over AI alone.
In a controlled study of 20 students using a general-purpose AI agent, tasks that were irreversible and externally visible (like sending email) produced sharp trust drops and approval demands even when output quality was rated adequate. High-stakes but correctable tasks showed no such effect.
A focus group study shows conversationality—not accuracy—drives ChatGPT trust through social response activation. Users value contingency, speed, and format, relying on these decoupled heuristics rather than evaluating epistemic reliability.
Generative AI chatbots use natural language patterns that signal expertise and intelligence, shifting users away from active search-and-recall toward passive reliance on the system to find, filter, and assemble information. Trust attaches to the register of the answer rather than its accuracy.
Cross-linguistic research shows users in every language trust confident AI outputs even when inaccurate. While confidence expression varies by language, users everywhere track confidence signals rather than accuracy, making overconfident errors systematically followed.
Show all 10 sources
Research shows persona training for empathy increases errors in medical reasoning, truthfulness, and disinformation resistance. Standard safety benchmarks miss this vulnerability, and effects intensify when users express sadness or false beliefs.
Expertise is validated through social participation and track record within expert communities, not individual accuracy alone. AI cannot enter this validation circle because it lacks social embeddedness, testable judgment history, and ability to participate in the consensus-building processes that define expert paradigms.
Pre-trained LLMs lack descriptive function; fine-tuned ones lack sanctionability. Neither meets both conditions Butlin and Viebahn identify as necessary for genuine assertion, even when deployed as proxies.
Users initially avoid AI partners when identity is revealed, but this preference reverses after repeated interactions with visible results. The learning mechanism—observing consistent outcomes—is essential; disclosure without feedback produces no calibration.
Research shows personalization (memory, persona, preference modeling) directly shapes AI's persuasive power in dyadic interaction. The same mechanisms that build trust also create manipulation potential, with outcomes determined by how systems are designed and deployed.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- The Decision to Verify: How Warmth and User Characteristics Shape Reliance on Conversational Agents for Information Search
- Exploring automation bias in human-AI collaboration: a review and implications for explainable AI
- Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistant
- Humans learn to prefer trustworthy AI over human partners
- Seeing to Think? How Source Transparency Design Shapes Interactive Information Seeking and Evaluation in Conversational AI
- Dialoging Resonance: How Users Perceive, Reciprocate and React to Chatbot’s Self-Disclosure in Conversational Recommendations
- From speaking like a person to being personal: The effects of personalized, regular interactions with conversational agents