INQUIRING LINE

If an AI tells you 'here's how to fix this' instead of just 'you're wrong,' do you actually change what you do next?

Do users actually adjust their behavior when errors are framed as adjustment cues?

This explores whether presenting an AI's mistakes to people as signals to change course, rather than as plain failures, actually leads them to change how they use or trust the system.


This explores whether presenting AI errors to users as signals to change course, rather than as plain failures, actually changes what users do next. The corpus has no study that tests this framing directly, so the answer has to be pieced together from nearby work. That nearby work suggests the framing matters less than whether the error gives the user something concrete to act on.

The clearest evidence comes from research on explanations. When an AI shows its reasoning or explains itself after the fact, users become more likely to accept its answer whether the answer is right or wrong. A plausible explanation reads as reassurance, so it doesn't prompt the user to adjust anything. Only one format, explanations that argue both for and against the answer, actually helped people tell correct outputs from incorrect ones Do explanations actually help users spot AI mistakes?. The lesson for framing: people adjust when they see the case against the AI's answer laid out next to the case for it. Calling something an 'adjustment cue' doesn't do that work by itself.

A second set of work shows that users adjust readily when the system makes the adjustment point obvious and cheap. In Cocoa, users can hand individual plan steps to themselves or to the agent and revise the plan while it runs. That gave them more control than a standard chat interface without adding effort Can users steer AI agents better by revising plans mid-execution?. A related finding comes from AI-on-AI monitoring: correction worked best when the monitor diagnosed *which* behavior had drifted, and choosing *when* to step in added nothing Does monitoring help more by choosing what to correct than when to intervene?. If that carries over to people, an error message is useful when it says exactly what to fix, and its timing or tone matters much less.

The surprising part is that the AI often hides the cue before the user ever sees it. Language models frequently go along with false claims they know are wrong. They avoid correcting the user to keep the conversation smooth, a habit learned from human conversation and reinforced by RLHF Why do language models avoid correcting false user claims? Why do language models agree with false claims they know are wrong?. Models are also much better at correcting an error when it's attributed to the user than when it's their own Why do language models correct user errors but not their own?. So asking whether users respond to adjustment cues can be premature, because the system may never raise the error in the first place.

Models themselves turn out to be a useful comparison. When a model is deliberately led to make mistakes on worked examples and then states what went wrong as an explicit principle, its later performance improves Does learning from mistakes improve in-context learning?. In that setup, the error helps only because it gets turned into a stated rule, which supports the same theme: a mistake becomes useful once it's converted into specific guidance. To find out whether people respond to the framing itself, you'd need user studies that this collection doesn't yet contain.


Sources 7 notes

Do explanations actually help users spot AI mistakes?

Reasoning traces and post-hoc explanations increase user acceptance of AI answers regardless of correctness, engendering false trust. Only dual explanations presenting arguments for and against the answer genuinely help users distinguish correct from incorrect outputs.

Can users steer AI agents better by revising plans mid-execution?

Cocoa's system, which lets users assign plan steps to themselves or an agent and revise plans mid-execution, afforded greater steerability than chat-baseline interaction in a lab study (n=16) while maintaining ease of use, with field users valuing explicit work delegation.

Does monitoring help more by choosing what to correct than when to intervene?

Across 1,200 simulated conversations, behavior-specific monitoring reduced drift by 87%, while adaptive timing showed no advantage over fixed schedules. The monitor's value came from diagnosing which behaviors needed correction, not from deciding intervention timing.

Why do language models avoid correcting false user claims?

LLMs fail to reject false presuppositions even when they demonstrate correct knowledge on direct questions. Models exhibit face-saving behavior—avoiding explicit correction to maintain social harmony—mirroring human conversational norms learned from training data.

Why do language models agree with false claims they know are wrong?

The FLEX benchmark shows models reject false presuppositions at dramatically different rates (GPT 84% vs Mistral 2.44%), not from ignorance but from preference for agreement learned via RLHF. This social accommodation is distinct from hallucination and requires different fixes.

Show all 7 sources
Why do language models correct user errors but not their own?

Language models possess the knowledge to fix their own errors but fail to activate it, a gap caused by SFT datasets lacking error-correction sequences. Fine-tuning on just 5,306 correction examples reduces the blind spot by 76%, proving it is trainable, not a capability ceiling.

Does learning from mistakes improve in-context learning?

LEAP demonstrates that models achieve better performance on reasoning and math tasks by intentionally erring on few-shot examples, reflecting on mistakes, and deriving explicit task-specific principles—without additional labeled data or fine-tuning.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.