How should agents decide when to act versus ask users?
When should an automated agent take action on its own versus defer to the user? Horvitz's framework suggests grounding this decision in probabilistic goal inference, cost-benefit analysis, and uncertainty rather than guessing.
Horvitz's 1999 CHI paper "Principles of Mixed-Initiative User Interfaces" sets out twelve principles for interfaces where "intelligent services and users... collaborate efficiently to achieve the user's goals," rather than choosing between direct manipulation and full automation. The paper frames the debate it answers: one group of researchers pursued "interface agents" that sense activity and take automated action, another pursued better direct-manipulation metaphors, and Horvitz argues the two should be coupled rather than treated as competing tacks. The key problems he names with agent-based interfaces are "poor guessing about the goals and needs of users, inadequate consideration of the costs and benefits of automated action, poor timing of action," and inadequate means for users to guide or correct automated results.
The twelve principles build on a few recurring mechanisms rather than standing as a flat checklist. Systems should infer a user's goals probabilistically under uncertainty, "employing machinery for inferring and exploiting the uncertainty about a user's intentions"; time action against a model of the user's attention, deferring when "action will be less distracting"; weigh the expected costs and benefits of a service before invoking it; use dialog to resolve uncertainty "considering the costs of potentially bothering a user needlessly"; give users efficient means to directly invoke or terminate services; minimize the cost of wrong guesses through graceful timeouts and easy rejection; scope service precision down under uncertainty rather than guess boldly, preferring "doing less" but correctly; support collaborative refinement of agent output; use socially appropriate default behaviors; maintain working memory of recent shared interactions; and keep learning from observation. Horvitz illustrates the principles with LookOut, a scheduling and meeting-management agent built into email.
Since When should human-agent systems ask for human help? names interrupt-timing as its "fundamental challenge" for a modern multi-agent orchestrator, Horvitz's framework supplies the earlier articulation of the same problem: expected cost-benefit reasoning under goal uncertainty, in place of a ground-truth label, as the basis for deciding when to act versus defer. What UX principles do workplace users want in AI agents? reports which of these values workplace users say they want today; Horvitz's principles are the designer-facing mechanisms — uncertainty modeling, dialog, direct override, graceful degradation — that aim at that same control and reliability two decades before the survey measured demand for it.
The excerpt is drawn from the abstract, introduction, principles list, and conclusion, and does not include LookOut's evaluation data, so it supports the principles as design guidance Horvitz offers, not as a validated outcome — no measurement of reduced interruption cost or improved task completion appears here. It also predates today's LLM-based agents by two decades: the inference machinery it describes is Bayesian-network goal inference, not language-model reasoning. The principles should be read as a framework later agentic-interface work builds on and departs from, not as a description of how current agents are built.
Inquiring lines that read this note 1
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How should conversational agents balance proactive goal-pursuit with user autonomy?Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
When should human-agent systems ask for human help?
Explores the timing problem in collaborative AI systems: since there's no objective metric for optimal interruption, how can we design deferral mechanisms that know when to involve humans without constant disruption or silent failures?
names the same interrupt-timing problem Horvitz addressed with cost-benefit reasoning under goal uncertainty
-
What UX principles do workplace users want in AI agents?
A multi-method study asked business users what design principles matter most for human-AI collaboration at work. The findings prioritize oversight and reliability over convenience.
reports today's user demand for the control and reliability Horvitz's mechanisms aimed to deliver
-
How should AI interfaces handle the shift from doing to supervising?
Nielsen explores what UI architecture allows users to oversee AI work rather than perform it themselves. This matters because intent-based systems fundamentally change the user's role from operator to supervisor.
its direct-manipulation fallback layer echoes Horvitz's call for efficient direct invocation and termination
-
Does chat delegation actually save time on task completion?
When users can delegate work to an AI agent through chat, interaction effort clearly drops—fewer clicks, scrolls, and navigations. But does that effort savings translate into finishing tasks faster? Understanding the gap between effort and speed matters for interface design.
a hybrid direct-manipulation-plus-agent interface tests the coupling Horvitz argued for, with mixed results
-
How can users verify what an AI agent actually plans to do?
Stating goals to an AI agent isn't enough for mutual understanding. What mechanisms would let users check both the agent's proposed plan and whether it truly grasps the user's goals and constraints?
Extends Horvitz's goal-uncertainty principle: stated goals alone aren't enough — users also need to verify agent plans for common ground
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Guidelines for Human-AI Interaction
- Principles of Mixed-Initiative User Interfaces
- Agentic Abstention: Do Agents Know When to Stop Instead of Act?
- Mapping the Design Space of User Experience for Computer Use Agents
- Levels of Autonomy for AI Agents
- Comparing Human Oversight Strategies for Computer-Use Agents
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Measuring AI agent autonomy in practice
Original note title
Horvitz's 1999 mixed-initiative interface principles ground automated agent action in expected costs, benefits, and uncertainty about user goals