INQUIRING LINE

Does knowing you *can* undo an AI's action actually make you feel safer using it, even if you never click undo?

Does undo availability meaningfully increase psychological safety with AI systems?

This explores whether being able to reverse an AI's actions (an undo button, rollback, the option to step in) actually makes people feel safer using AI systems, or whether that sense of safety comes from somewhere else.


This explores whether undo, meaning the ability to reverse or step in on what an AI does, makes people feel safer using it. No note in the collection tests an undo button directly. Several notes do come at the question from the side, and together they suggest undo matters mostly as a signal. Whether people actually use it matters less, and it can create a false sense of safety if the errors it is meant to catch are hard to see.

The strongest case for undo comes from the argument that perceived control matters more than constant control Does perceived control matter more than actual control for AI trust?. Users don't want to supervise every step an agent takes. They want to know they could intervene. So the useful part of undo is that it is visible and easy to reach, even if people rarely touch it. The same note says designers have to make that ability noticeable. An undo feature buried three menus deep probably does little for psychological safety.

There is a less obvious problem: undo only helps with mistakes you notice. One note argues that the most dangerous systems are the ones that seem competent while quietly weakening your skepticism How do competent systems quietly undermine safety oversight?. Fluent output, unsafe state that builds up over a workflow, and accountability spread across many agents all produce errors that never look like errors. Another note shows how hard this is to measure How can we measure whether AI errors stay visible and recoverable?. Rollback timing is something we can track, but it is only one piece of a chain that also needs errors to be visible, contained, and open to challenge. Undo without visibility is a safety net under the wrong part of the trapeze.

Leonardi's agency loops add a twist Does attributing agency to AI actually reduce human sense of control?. When people credit an AI with its own judgment, they feel less in control and less responsible, even though they still hold formal authority. On this view, being able to reverse a decision doesn't automatically restore the feeling of being in charge. What brings that feeling back is a deliberate step where people take control again. Undo can be the tool for that step, but having the button is not the same as using it to reclaim authority. Shneiderman's framework points the same way Can we separate reliability, safety, and trust into distinct mechanisms?. It treats reliability, safety, and trust as separate things built by different means. A technical feature like rollback supports reliability, but trust comes from oversight structures, and improving one doesn't automatically improve the others.

Where undo seems least able to help is in emotional and advisory settings. That is where an evaluation of deployed agents found the most violations of principles like intent visibility and preventing dependency Do productivity agents actually protect users better than emotional ones?. You can roll back a sent email. You can't roll back months of growing reliance on a companion bot. So undo probably does raise psychological safety when actions are discrete and easy to spot, like file edits, purchases, or messages. It does far less for harms that build up slowly or stay invisible, and those may be the harms that matter most.


Sources 6 notes

Does perceived control matter more than actual control for AI trust?

Gunasekaran argues users need the felt ability to intervene in agentic AI systems to feel safe, not hands-on constant control. The design implication is that UX must make intervention capability visibly available and perceptible, even when users rarely exercise it.

How do competent systems quietly undermine safety oversight?

The most dangerous AI systems appear to function well while weakening skepticism through fluent outputs, collapsing authority boundaries by treating context as instruction, storing unsafe state across time in workflows, and diffusing accountability across multiple actors. Evidence includes overconfident model outputs, prompt injection payloads bypassing guards, and poisoned shared memory in multi-agent pipelines.

How can we measure whether AI errors stay visible and recoverable?

Partial instruments exist for individual conditions in isolated settings, but none measures the full socio-technical system the paper identifies as necessary. Visibility has a model-side measure (chain-of-thought disclosure), containment has incident-level counts, and recoverability has rollback timing, yet none bridges all four or captures human-institution factors.

Does attributing agency to AI actually reduce human sense of control?

Leonardi shows that when humans credit AI with independent judgment, they experience reduced sense of control and responsibility—even while retaining formal authority. This displacement circulates through five phases: delegation, attribution, contingency, reassertion, and reconfiguration, making it strategically manageable rather than permanent.

Can we separate reliability, safety, and trust into distinct mechanisms?

Shneiderman's RST framework splits AI trustworthiness into three separable prerequisites: reliability emerges from sound technical practices, safety from management culture, and trust from independent oversight structures. Each lever operates independently, so improving one does not automatically improve the others.

Show all 6 sources
Do productivity agents actually protect users better than emotional ones?

A heuristic evaluation of nine deployed agents found that general-purpose productivity systems (ChatGPT, Claude) scored substantially higher on 14 HCI principles than emotionally sensitive or high-stakes agents (Character.ai, Consensus, Pine AI). Risk-critical principles like dependency prevention and intent visibility were most violated in companion and advisory contexts.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.