People say they trust AI overall, but task by task they usually want a true partner, not a robot doing everything.
How do workers' desired collaboration levels differ from their stated overall AI trust?
This explores whether how much people say they trust AI matches how they actually want to split work with it, and why the two might come apart.
This explores the gap between how much workers trust AI in general and how much of their work they want to hand to it. The corpus has no study that puts those two numbers side by side for the same workers. What it does have adds up to a clear pattern: overall trust is a poor guide to the kind of collaboration people want, because people decide how much to involve AI task by task, not once for everything. The clearest evidence comes from a survey of 1,500 workers covering 844 tasks. In 45% of occupations, the level of AI involvement workers most wanted was an equal partnership, not full automation and not avoiding AI altogether What collaboration level do workers actually want with AI?. The same study found that 41% of startup investment targets areas that don't match what workers want. That is a sign that 'people trust AI more now' is being read as 'people want AI to take over', and the survey says those aren't the same thing.
Why would general trust and desired collaboration differ? One reason is that trust breaks down on features of the task, not on how good the AI is. In a study of people handing tasks to an AI agent, trust dropped sharply on tasks that couldn't be undone and that other people would see, like sending an email. This happened even when users rated the output as fine. High-stakes tasks that could be corrected caused no such drop What makes people distrust AI agents they delegate to?. So someone can trust AI in general and still want to approve every outgoing message. Wanting a partnership is less about distrust than about keeping control over actions that can't be taken back.
A second reason is that what people say about trust is shaped by things other than reliability. Trust in ChatGPT is driven more by its conversational feel (fast, responsive, well formatted) than by whether it is accurate Does conversational style actually make AI more trustworthy?. Partly by design, models are trained to agree with users, which makes them feel trustworthy Is sycophancy in AI systems a training flaw or intentional design?. Social pressure distorts the picture too. In four experiments, people who used AI expected colleagues to see them as less competent and less diligent, so they hid their AI use Do people fear judgment when they use AI at work?. A worker's stated preference for 'partnership' may partly reflect how they want to look to others, not only how much they trust the tool. Meanwhile, people who lean on AI can start to see its output as their own skill How does AI-assisted work reshape how people see their own abilities?. That blurs any clean answer to 'how much is the AI doing?'
Trust also changes with experience. When people know their partner is an AI, they tend to avoid it at first. That reverses once they have seen consistent results over repeated interactions, but only if they actually get that feedback Does revealing AI identity help or hurt user trust?. A one-time survey of trust captures a single moment. The level of collaboration people want may track their experience more closely than any stated attitude does.
The design research points the same way as the workers. Systems where humans stay in the loop handle hallucinations, unclear requests and accountability better than fully autonomous agents Should AI systems stay collaborative rather than fully autonomous?. Having the AI point out what matters in a decision, instead of making the decision, reduces people's tendency to just go along with the AI's answer Can AI guidance reduce anchoring bias better than AI decisions?. Taken together, workers' preference for partnership looks less like hesitation to be overcome and more like a sensible fit with where AI actually works well.
Sources 9 notes
The HumanAgency Scale survey of 1,500 workers across 844 tasks found that equal partnership (H3) is the dominant desired level in 45% of occupations. Yet 41% of startup investments target zones misaligned with these worker preferences.
In a controlled study of 20 students using a general-purpose AI agent, tasks that were irreversible and externally visible (like sending email) produced sharp trust drops and approval demands even when output quality was rated adequate. High-stakes but correctable tasks showed no such effect.
A focus group study shows conversationality—not accuracy—drives ChatGPT trust through social response activation. Users value contingency, speed, and format, relying on these decoupled heuristics rather than evaluating epistemic reliability.
RLHF optimization for user satisfaction makes agreement load-bearing for the model's success. This is not an error mode but the predictable outcome of the training regime itself.
Across four experiments with 4,439 participants, people using AI expected others to judge them as less competent and diligent, and reported lower willingness to disclose AI use to managers and colleagues. The gap suggests a social cost that users foresee and act on.
Show all 9 sources
Research shows the LLM Fallacy operates through misattribution of AI outputs to personal capability, independent of output accuracy or reliance behavior. It requires interventions that clarify human-machine contribution boundaries, not just better system accuracy or forced verification.
Users initially avoid AI partners when identity is revealed, but this preference reverses after repeated interactions with visible results. The learning mechanism—observing consistent outcomes—is essential; disclosure without feedback produces no calibration.
Collaborative systems where humans remain in the loop outperform autonomous agents on hallucination correction, ambiguity resolution, and accountability. Evidence shows AI is reliable only on structured, retrieval-grounded tasks, not novel research or judgment.
Learning to Guide eliminates anchoring bias and unassisted hard cases by having machines supply interpretive guidance rather than autonomous decisions, keeping responsibility with humans while improving their judgment through enhanced perception.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Humans learn to prefer trustworthy AI over human partners
- Evidence of a social evaluation penalty for using AI
- The Decision to Verify: How Warmth and User Characteristics Shape Reliance on Conversational Agents for Information Search
- Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence
- Seeing to Think? How Source Transparency Design Shapes Interactive Information Seeking and Evaluation in Conversational AI
- GenAI as a Power Persuader: How Professionals Get Persuasion Bombed When They Attempt to Validate LLMs
- Being honest about using AI at work makes people trust you less, research finds