How should AI agents balance helpfulness with staying out of the way?
Microsoft Design explores whether AI agents should proactively intervene or remain invisible until needed, and how to make them discoverable without being intrusive or replacing human judgment.
Microsoft Design's cross-functional team, writing as Ruokan He, Jen Fox, and Amanda Snellinger, states that its "Agent UX Design Principles have three high-level categories with 6 sub-categories": "Connecting, not collapsing"; "Easily accessible yet occasionally invisible"; and "Embrace uncertainty but establish trust." The middle category is broken into three named sub-points — Past, Now, and Future — and the essay adds a cross-cutting statement that "transparency, control, and consistency are foundational elements of all agents," applying to the whole set rather than to one category.
Each category carries its own stated reasoning. Under "connecting, not collapsing," the authors write that agents "bring people closer together" and "are not designed to replace or belittle people," and should be "discoverable, intuitive, and accessible... on any device or platform." Under "easily accessible yet occasionally invisible," an agent draws on "memory and connected databases" to act on "richer historical data beyond singular events, user queries, or states," and rather than issuing a "static notification," it may "proactively start a chat or create artifacts" to "direct the user's attention at the right moment" — adapting across devices and modalities, for example "voice-first interaction on mobile but text-first interaction on a PC." Under "embrace uncertainty but establish trust," the authors treat uncertainty itself as "a key element of agent design," to be paired with a visible "level of certainty and reasoning," customizable settings, an explicit on/off control, and an agent status "clearly visible at all times," stated purpose being "to avoid overreliance."
The nearest comparison is What UX principles do workplace users want in AI agents?, which also names a structured set of agent UX principles meant as design guardrails. The two sets do not line up: that paper's eight principles were derived from workshops and interviews and weighted by what workplace users said they prioritize, while Microsoft's three categories are stated as the design team's own cross-functional position, not derived from a study of user priorities. Within that difference, the call to make "level of certainty and reasoning... visible and/or easily accessible to the user" extends How can users verify what an AI agent actually plans to do? from verifying an agent's plans specifically to verifying its underlying confidence more generally. The requirement that background agents carry "a user-facing mechanism to view and control actions and automations" also echoes the knowledge-and-observation half of Does human-in-the-loop design actually enable effective oversight?, though Microsoft's essay treats status visibility and control as a principle to build rather than a fallacy to diagnose.
The excerpt is a practitioner essay, not a study: it gives no methodology for how the principles were chosen beyond "we've worked cross-functionally," no evaluation of built agents against the principles, and names only three of the stated six sub-categories, leaving the sub-categories under "connecting" and "embrace uncertainty" unspecified. It does not claim the principles were tested with users or that following them changes trust or adoption. At this strength, the excerpt establishes only what one named design team at Microsoft has adopted as its own internal design principles for agents, offered as guidance rather than demonstrated result.
Inquiring lines that read this note 3
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do users build accurate mental models when agent reasoning is partially hidden? How should control and autonomy be allocated in human-AI workplace collaboration? How can AI systems be proactive while respecting user intent?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
What UX principles do workplace users want in AI agents?
A multi-method study asked business users what design principles matter most for human-AI collaboration at work. The findings prioritize oversight and reliability over convenience.
closest comparison: a differently-derived, differently-organized set of agent UX principles from a validated study rather than a design team's own position
-
How can users verify what an AI agent actually plans to do?
Stating goals to an AI agent isn't enough for mutual understanding. What mechanisms would let users check both the agent's proposed plan and whether it truly grasps the user's goals and constraints?
extends plan verification to visible agent confidence and reasoning as a design principle
-
Does human-in-the-loop design actually enable effective oversight?
When AI agents include humans in the decision loop, does that automatically provide meaningful oversight? The research explores what specific capabilities humans need to actually oversee agent behavior.
echoes the knowledge-and-observation requirement as a design principle to build, not a fallacy to diagnose
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Design for agents
- UX design for agents
- The Designer's AI Glossary: Familiar Words, New Meanings
- Designing for Autonomy: UX Principles for Agentic AI
- "When to Hand Off, When to Work Together": Understanding Concurrent Human-Agent Interaction in Shared Co-Creative Workspaces
- A Framework of User Experience Principles for Human-AI Agent Interaction in the Workplace
- Designing For Agentic AI: Practical UX Patterns For Control, Consent, And Accountability
- Designs for the frontier future
Original note title
Microsoft Design's agent UX principles organize around connecting not collapsing, accessible yet invisible, and embracing uncertainty