Letting an AI decide for you might not cost you power, but it can quietly cost you the feeling of being in charge.
Does ceding decision control to AI impose a psychological cost on users?
This explores whether handing decisions over to an AI changes how people feel — their sense of control, responsibility and agency — and not just how well the decisions turn out.
This explores whether letting AI make decisions changes how people feel about their own control and responsibility, and not only whether the outcomes are good. The corpus says yes, there is a cost. But it lands somewhere you might not expect. The main loss is not formal authority. It is the *felt* sense of being in charge. Leonardi's agency-loops framework shows that once people credit an AI with independent judgment, their sense of control and responsibility drops, even though they still formally hold the decision Does attributing agency to AI actually reduce human sense of control?. You can keep the veto and still feel like a passenger.
The useful part is that this loss isn't permanent or one-way. Leonardi describes it as a cycle: people delegate, credit the AI with agency, hit a surprise, take control back, and then rearrange how the work is shared. That fits Gunasekaran's argument that what matters is *perceived* control rather than constant hands-on oversight Does perceived control matter more than actual control for AI trust?. People don't need to steer every step. They need to feel they could step in. So much of the psychological cost may be a design choice: an interface that hides the 'take back the wheel' option creates the cost, and one that keeps it visible largely removes it.
How the work is split matters as much as how much of it is handed over. One memory-privacy design has users state what they want while the AI carries out the edits. It is pitched as lowering mental effort *and* raising the sense of agency at the same time Does splitting privacy work between users and AI reduce cognitive burden?. Puranam makes the same point at the scale of organizations: pairing a human with an AI is like designing a small organization, and which tasks go where changes the results How should humans and AI systems divide decision-making tasks?. Handing over the *doing* while keeping the *wanting* seems to be where people lose the least.
Two findings complicate the picture. First, giving up control can *relieve* a psychological burden. People who are likely to cheat prefer reporting to a machine because no one is judging them, so dishonesty feels less costly Do dishonest people prefer talking to machines?. Losing the feeling of responsibility can be exactly what makes delegation appealing, and that is a risk in itself. Second, forcing control back onto people isn't free either. 'Cognitive forcing functions' (design features that make users think a decision through before accepting the AI's answer) helped people who enjoy effortful thinking much more than everyone else, which widened the gap between users Do cognitive forcing functions help all decision makers equally?. Both losing control and being made to take it back come with costs, and they fall on different people.
The stakes grow with context. Risk to people rises steadily with how much autonomy an agent is given Does AI risk increase with the autonomy we give it?. In an audit of nine deployed agents, 'dependency prevention' was most often violated by companion and advisory agents, exactly where users are most emotionally invested Do productivity agents actually protect users better than emotional ones?. One honest gap: the corpus has strong frameworks and design arguments, but little direct measurement of well-being outcomes like stress, regret or learned helplessness from long-term delegation. That question is still mostly open.
Sources 8 notes
Leonardi shows that when humans credit AI with independent judgment, they experience reduced sense of control and responsibility—even while retaining formal authority. This displacement circulates through five phases: delegation, attribution, contingency, reassertion, and reconfiguration, making it strategically manageable rather than permanent.
Gunasekaran argues users need the felt ability to intervene in agentic AI systems to feel safe, not hands-on constant control. The design implication is that UX must make intervention capability visibly available and perceptible, even when users rarely exercise it.
MemoAnalyzer's design divides memory-privacy labor: users state preferences, AI executes edits. This role split is proposed as a way to reduce cognitive load and improve perceived agency, though validation metrics and conflict-resolution processes remain undescribed.
Puranam frames human-AI pairs as multi-agent organizations requiring design choices about task division and learning configuration. He distinguishes three task types and shows learning mechanisms produce different performance outcomes based on feedback structure and decision architecture.
Experimental evidence shows people likely to cheat significantly prefer reporting to online forms rather than humans, because machines function as judgment-free zones where deception carries less psychological burden.
Show all 8 sources
An experiment (N=199) found that forcing functions helped participants high in Need for Cognition significantly more than those low in it, creating intervention-generated inequality despite aggregate benefits.
Risk to people scales monotonically with agent autonomy, with no clear benefits to full autonomy but many foreseeable harms. A governed spectrum of autonomy levels is safer and more practical than either unrestricted agents or exhaustive oversight.
A heuristic evaluation of nine deployed agents found that general-purpose productivity systems (ChatGPT, Claude) scored substantially higher on 14 HCI principles than emotionally sensitive or high-stakes agents (Character.ai, Consensus, Pine AI). Risk-critical principles like dependency prevention and intent visibility were most violated in companion and advisory contexts.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants
- Choose Your Agent: Tradeoffs in Adopting AI Advisors, Coaches, and Delegates in Multi-Party Negotiation
- Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents
- Privacy Leakage Overshadowed by Views of AI: A Study on Human Oversight of Privacy in Language Model Agent
- Homo agenticus in the age of agentic AI: Agency loops, power displacement, and the circulation of responsibility
- Fully Autonomous AI Agents Should Not be Developed
- Human-AI collaborative decision-making as an organization design problem