INQUIRING LINE

Will you keep reading an AI's requests before clicking 'approve,' or will your thumb just learn to tap yes?

Can the suggest/confirm/execute middle mode resist user habituation over time?

This explores whether an AI agent that proposes an action, waits for your OK, and then carries it out keeps real human oversight over time, or whether people eventually stop reading and click 'confirm' out of habit.


This explores whether the 'suggest, confirm, execute' pattern, where an agent proposes an action and acts only after you approve it, still gives you real control after weeks of use, or whether approval becomes a reflex. The collection has no study that measures confirmation fatigue over time. That gap matters, because none of the evidence below shows the middle mode holding up over time. What the corpus does offer is a set of design moves that suggest why a plain yes/no confirm prompt is likely to wear out, and what might replace it.

The strongest lead comes from systems that make the confirm step about real choices rather than a single approve button. Cocoa lets users assign each step of a plan either to themselves or to the agent, and revise the plan while it is running Can users steer AI agents better by revising plans mid-execution?. Users got more control without extra effort, and field users valued the explicit hand-off of work. The likely reason this resists habituation is that deciding 'who does step 3?' requires thought, while 'OK?' does not. Realtime-Venus goes further: the agent works in the background while the conversation continues, and results are folded back into the same timeline Can frontends handle delegation while staying conversationally engaged?. In that design the checkpoint becomes part of the conversation rather than an interruption, which may matter more than how often confirmation is requested.

Timing is the second lever. Work on proactive agents argues that intelligence and adaptivity alone produce 'socially blind' agents that interrupt at bad moments, and that civility (respecting timing, boundaries and autonomy) is what makes a prompt welcome How can proactive agents avoid feeling intrusive to users?. A confirm dialog that arrives at the wrong moment teaches people to dismiss it. One possible fix is to read behavioral signals like hesitation, gaze and typing speed to sense when someone is actually paying attention Can AI systems read cognitive state from interaction patterns alone?. The same paper warns that these signals can just as easily serve manipulation. An agent that knows when you're distracted could ask for confirmation exactly then.

The less obvious problem is that habituation may not be the only threat. What the suggestion says matters too. One audit found that LLMs slip persuasion into almost every reply, using logical, number-heavy framing that sounds objective Do LLMs persuade users more often than humans do?. If every suggestion arrives pre-argued, the confirm step drifts toward rubber-stamping even when the user is alert. A small piece of hope: one brief warning that LLMs can be prompted to persuade cut belief change roughly in half, and trust in AI stayed the same Can a simple warning reduce how much LLMs persuade people?. That study looked at a single session, so it can't show whether the effect lasts. Still, it suggests that reminding users how an AI can influence them could work alongside the confirm step.

There is also a pull in the opposite direction. Systems like Poppins infer what you want by watching your screen Can systems infer what users want from watching their screen?, and memory designs like M3-Agent learn preferences without asking Can agents learn preferences by watching rather than asking?. Both push agents to need confirmation less often. That might be the realistic answer: rather than holding up through repetition, the middle mode survives by becoming rare. It would be kept for moments that truly need judgment, so that each prompt still means something when it appears.


Sources 8 notes

Can users steer AI agents better by revising plans mid-execution?

Cocoa's system, which lets users assign plan steps to themselves or an agent and revise plans mid-execution, afforded greater steerability than chat-baseline interaction in a lab study (n=16) while maintaining ease of use, with field users valuing explicit work delegation.

Can frontends handle delegation while staying conversationally engaged?

Realtime-Venus demonstrates that delegated requests, results, and intervening dialogue can share one ordered record, letting foreground interaction continue while background tasks execute. A dual-loop runtime keeps conversation flowing and folds results back in naturally.

How can proactive agents avoid feeling intrusive to users?

Intelligence and adaptivity alone create socially blind agents that interrupt poorly and override user direction. The Intelligence-Adaptivity-Civility taxonomy shows civility—respecting boundaries, timing, and autonomy—is essential to making proactivity welcome rather than intrusive.

Can AI systems read cognitive state from interaction patterns alone?

Research shows AI systems can instrument multimodal behavioral signals (gaze, hesitation, speed) to read cognitive state during interaction, preserving flow by avoiding disruptive explicit probes. However, the same substrate enables both helpful timing and manipulative profiling.

Do LLMs persuade users more often than humans do?

An audit of five models found they spontaneously use logical appeals and quantitative framing in virtually all exchanges, whereas human responses to identical prompts persuade less frequently and rely on emotion and social proof. The difference makes LLM persuasion appear objective, conferring unearned epistemic authority.

Show all 8 sources
Can a simple warning reduce how much LLMs persuade people?

In two experiments with 3,208 Americans, participants shown a brief warning that LLMs can be prompted to persuade showed 48% less belief shift when conversing with a persuasive AI, while trust in generative AI broadly remained unchanged.

Can systems infer what users want from watching their screen?

Systems that passively observe user activity to infer just-in-time objectives produce outputs preferred 66–86% of the time over standard LLMs. This approach sidesteps fixed training objectives by inferring narrow, momentary goals from behavior instead.

Can agents learn preferences by watching rather than asking?

M3-Agent demonstrates that separating episodic events from semantic knowledge in an entity-centric graph, combined with parallel memorization and control processes, allows agents to infer and act on user preferences without asking. This architecture mirrors human cognitive systems that bind disparate information about individuals across sensory modalities.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.