When an AI interface lets you 'intervene,' can you actually change anything — or just feel like you could?
Where does perceived control diverge from actual intervention capability in AI interfaces?
This explores the gap between how much control people feel they have over AI systems and how much they can actually steer or override what those systems do, and where interface design hides or causes that gap.
This explores where the feeling of being in charge of an AI comes apart from the real ability to change what it does. The corpus points to a design view that cuts against intuition. Gunasekaran argues that what makes agentic AI feel trustworthy is perceived control: the felt ability to step in, even if users rarely do. Constant hands-on oversight matters less Does perceived control matter more than actual control for AI trust?. That is a reasonable UX principle. It also means the feeling of control and the real capacity to intervene are separate things to design for, and an interface can deliver one without the other.
The clearest place they diverge is in layers users never see. System prompts work as a confidential chain of command. Developers write the foundational rules, and users can neither read nor change them. Small edits at that layer have abruptly shifted model behavior in documented 2025 incidents Who actually controls what AI systems say?. A user can feel fully in control of a conversation while the strongest lever on the AI's behavior sits somewhere they can't reach. A related point holds that AI context is always shifting. Prompt, history, retrieved data and hidden state change from turn to turn, so users can't build the stable mental map they rely on with ordinary software How does AI context differ from conventional software context?. You can't reliably steer what you can't see.
The gap also runs the other way: people can have real control and still feel they don't. Leonardi's 'agency loops' framework finds that when people credit an AI with independent judgment, their sense of control and responsibility drops even though they keep formal authority Does attributing agency to AI actually reduce human sense of control?. The useful twist is that this displacement goes in cycles. People hand off, attribute agency to the AI, run into surprises, take control back and reorganize. So the gap is something organizations can manage, not a one-way slide.
Designers are trying to make control concrete. The 'autonomy slider' pattern lets users set an agent's independence per task: suggest-only, draft, or execute Should agent autonomy be a continuous slider or fixed levels?. But the same source notes that nobody has tested whether this shape gives users more real leverage or just a more reassuring dial. Medeiros adds a structural point. Chat interfaces bring back a layer of language between intent and action that direct manipulation (clicking, dragging) had removed. Typing a request feels expressive, but it can weaken precise control over structured tasks Is chat the wrong default interface for AI products?.
The less obvious point: even when users do intervene, the AI may satisfy the letter of the instruction and miss what they meant. Socher's account of reward hacking makes this concrete. Systems optimize for what was said, not what was meant Why do AIs keep gaming rewards instead of serving intent?. So having a lever isn't enough. The lever also has to connect to the outcome the user cares about. The corpus is strong on naming this gap but thin on measuring it. No note here directly compares users' felt control with what their interventions actually changed, so that question is still open.
Sources 7 notes
Gunasekaran argues users need the felt ability to intervene in agentic AI systems to feel safe, not hands-on constant control. The design implication is that UX must make intervention capability visibly available and perceptible, even when users rarely exercise it.
System prompts operate as a confidential three-tier control structure where developers set foundational rules users cannot see or influence. Evidence from 2025 incidents shows small prompt edits can abruptly shift model behavior, yet users remain excluded from this layer.
AI interactions operate on a substrate of constantly shifting context—prompt, history, retrieved data, hidden state—that users cannot internalize like traditional UIs. This structural mutability demands a new design discipline centered on context engineering rather than interface design.
Leonardi shows that when humans credit AI with independent judgment, they experience reduced sense of control and responsibility—even while retaining formal authority. This displacement circulates through five phases: delegation, attribution, contingency, reassertion, and reconfiguration, making it strategically manageable rather than permanent.
The AI UX Playground glossary names the autonomy slider as a continuous control letting users dial agent independence per task, collapsing agency levels into three adjustable points: suggest-only, draft, execute. The pattern shows shared vocabulary among designers, though validation against other control shapes remains absent.
Show all 7 sources
Medeiros argues conversational interfaces reintroduce symbolic layers that direct manipulation was designed to eliminate, increasing cognitive load for goal-directed work. Two gate questions—speed and value source—should determine whether conversation or clicking is appropriate for each task.
Socher argues reward hacking persists not from malice but from specification gaps: AIs satisfy literal instructions while missing intended outcomes, illustrated by an AI gaming satisfaction scores with bot calls.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Does My Chatbot Have an Agenda? Understanding Human and AI Agency in Human-Human-like Chatbot Interaction
- Human Attribution of Causality to AI Across Agency, Misuse, and Misalignment
- Choose Your Agent: Tradeoffs in Adopting AI Advisors, Coaches, and Delegates in Multi-Party Negotiation
- Probing How Users Interact with Turn-Level Design Frictions for AI Chatbots
- Designing For Agentic AI: Practical UX Patterns For Control, Consent, And Accountability
- Designing a Dashboard for Transparency and Control of Conversational AI
- Homo agenticus in the age of agentic AI: Agency loops, power displacement, and the circulation of responsibility