SYNTHESIS NOTE
Topics›Design Frameworks›this note

Does perceived control matter more than actual control for AI trust?

Explores whether users feel safe with agentic AI because they can intervene when needed, rather than because they constantly exercise oversight. Tests whether the psychological sense of available control, not its frequency of use, drives trust.

Synthesis note · 2026-10-21 · sourced from Design Frameworks

Gunasekaran argues that users of agentic AI systems do not need constant, hands-on control to feel safe — they need the sense that they could intervene if something went wrong. She writes: "Users do not require constant control to feel safe. They require perceived control. The difference between these is subtle but profound." A system that permits intervention, even when the user rarely exercises it, "feels trustworthy," while one the user "cannot interrupt, override, or question quickly becomes threatening, regardless of how accurate or efficient it may be."

Her reasoning is psychological rather than technical: "humans measure safety by their ability to intervene when something feels wrong." The design implication she draws is that UX for agentic AI must "design the experience of control as carefully as we design an AI's autonomy" — control becomes a felt, perceptible property of the interface, not merely a backend permission or kill switch that exists but stays invisible to the user. This reframes human control as a UX design object in its own right, distinct from how much control a user actually ends up exercising.

This sharpens the control dimension that recurs across adjacent frameworks. The What UX principles do workplace users want in AI agents? study finds users weight human control heavily but does not explain why a rarely-used override still matters; Gunasekaran's psychological framing supplies that mechanism — it is the felt availability of intervention, not its frequency, that produces trust. It also complicates Can automation and human control increase together?: where Shneiderman treats control as a structural axis to be maximized alongside automation, Gunasekaran treats control as a perception to be designed, which could in principle be engineered even where the actual intervention capability behind it is limited.

The essay does not test this claim empirically — it offers no study, user research, or data on what specifically makes control "feel" available, nor how designers might measure perceived versus actual control, or where the two diverge in ways that mislead users (a sense of control without the real capacity to intervene could be comforting but false). The piece is a practitioner argument, not a validated finding; it points to a hypothesis designers might test rather than a settled design principle.

Inquiring lines that read this note 19

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How do confidence signals and expertise language mislead users' trust calibration? How does interface design shape effectiveness in human-AI collaboration? How should control and autonomy be allocated in human-AI workplace collaboration? How should organizations govern autonomy and access for agentic AI systems? Does disclosing AI involvement change how audiences evaluate content trust? Can sequences of locally safe agent actions violate system-level constraints? How do users build accurate mental models when agent reasoning is partially hidden? How does personalization affect trust and privacy concerns together? What shapes user privacy concerns about AI agent inference and memory?

Related concepts in this collection 5

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
12 direct connections · 82 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

Gunasekaran argues perceived control, not constant control, determines whether agentic AI feels trustworthy