If an AI shows you just a little of what it's doing, does that glimpse actually make it feel less creepy — or just seem that way?
Can partial visibility into AI workings reduce perceived intrusiveness?
This explores whether showing users some of what an AI is doing (its intentions, its memory, its ability to be stopped) makes it feel less invasive, even without exposing everything, and whether that comfort is earned.
This explores whether letting people see part of what an AI is doing makes it feel less intrusive, and whether that feeling matches reality. No study in the corpus tests this directly. Several nearby threads point to the same answer: partial visibility does change how intrusive an AI feels, but the feeling and the actual protection can drift apart.
The strongest case for 'yes' is about control rather than transparency. Does perceived control matter more than actual control for AI trust? argues that people don't need to watch an agent all the time to feel safe. They need to see that they could step in. The visible option to intervene does the work, even if it's rarely used. Proactive agents show the same thing from the other side. How can proactive agents avoid feeling intrusive to users? finds that what makes a helpful agent feel invasive is bad manners, not intelligence: interrupting at the wrong moment, or overriding what the user asked for. So making an agent's timing and intentions readable reduces the feeling of intrusion. An audit of deployed agents found that 'intent visibility' is the principle most often violated in companion and advisory apps, which are the places where intrusion matters most Do productivity agents actually protect users better than emotional ones?.
There's a catch the reader might not expect. Feeling safe and being safe can come apart. In Why do people feel safe sharing when they haven't actually removed sensitive information?, people who manually edited chatbot transcripts felt just as confident about their privacy as people who had AI help, yet they left far more identifying information in. Their comfort came from the editing interface, not from what they had actually removed. Partial visibility can therefore reduce perceived intrusiveness while leaving the real exposure where it was. Splitting the work so users state their privacy preferences and the AI carries them out Does splitting privacy work between users and AI reduce cognitive burden? reduces mental effort, but the same gap could exist there too.
Time also matters. Telling people they're dealing with an AI first makes them more wary. That wariness reverses only after they repeatedly see how things turn out Does revealing AI identity help or hurt user trust?. Disclosure alone doesn't calibrate anyone. Visibility helps when it comes with a feedback loop. Meanwhile, some layers are never visible at all. System prompts form a hidden chain of authority that end users can't see or influence Who actually controls what AI systems say?. So the 'partial' in partial visibility is often chosen by someone else.
The takeaway: partial visibility does reduce perceived intrusiveness, especially visible ways to intervene and readable intentions. Designers should treat that as a trust-building tool that can also manufacture comfort. The honest test is whether what users can see matches what is actually happening to them.
Sources 7 notes
Gunasekaran argues users need the felt ability to intervene in agentic AI systems to feel safe, not hands-on constant control. The design implication is that UX must make intervention capability visibly available and perceptible, even when users rarely exercise it.
Intelligence and adaptivity alone create socially blind agents that interrupt poorly and override user direction. The Intelligence-Adaptivity-Civility taxonomy shows civility—respecting boundaries, timing, and autonomy—is essential to making proactivity welcome rather than intrusive.
A heuristic evaluation of nine deployed agents found that general-purpose productivity systems (ChatGPT, Claude) scored substantially higher on 14 HCI principles than emotionally sensitive or high-stakes agents (Character.ai, Consensus, Pine AI). Risk-critical principles like dependency prevention and intent visibility were most violated in companion and advisory contexts.
Across 188 participants, those manually editing chatbot transcripts reported equivalent privacy confidence as those using AI suggestions, yet left substantially more identifiable information in their final transcripts. This decoupling suggests comfort reflects editing interface design rather than actual data exposure.
MemoAnalyzer's design divides memory-privacy labor: users state preferences, AI executes edits. This role split is proposed as a way to reduce cognitive load and improve perceived agency, though validation metrics and conflict-resolution processes remain undescribed.
Show all 7 sources
Users initially avoid AI partners when identity is revealed, but this preference reverses after repeated interactions with visible results. The learning mechanism—observing consistent outcomes—is essential; disclosure without feedback produces no calibration.
System prompts operate as a confidential three-tier control structure where developers set foundational rules users cannot see or influence. Evidence from 2025 incidents shows small prompt edits can abruptly shift model behavior, yet users remain excluded from this layer.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Privacy Leakage Overshadowed by Views of AI: A Study on Human Oversight of Privacy in Language Model Agent
- Disclose with Care: Designing Privacy Controls in Interview Chatbots
- "Ghost of the past": identifying and resolving privacy leakage from LLM's memory through proactive user interaction
- Understanding Users' Security and Privacy Concerns and Attitudes Towards Conversational AI Platforms
- When Are LLM Inferences Acceptable? User Reactions and Control Preferences for Inferred Personal Information
- Humans learn to prefer trustworthy AI over human partners
- Design Principles for Human-Agent Interaction