Can warning labels on AI advice stop people from trusting bad answers without scaring them off good ones?
Can disclaimer design improve appropriate reliance without causing under-reliance costs?
This explores whether warnings, labels, and other friction added to AI answers can help people reject bad AI advice without also making them throw out good advice.
This explores whether the way AI warns or slows people down can tune their trust to the right level: catching bad advice without making them suspicious of good advice. The corpus has no study that tests disclaimer wording directly. It does have one sharp result on the closely related idea of friction design, and that result is a warning. When 400 people got GPT-4o advice with three different 'cognitive forcing' interventions (designs that make you stop and think before accepting an answer), all three cut over-reliance. All three also pushed people toward rejecting advice they should have taken. Only one intervention reduced both kinds of error, and only on one type of task Can we design interventions that reduce reliance on bad LLM advice?. So the honest short answer is: usually not. Most friction moves people from trusting too much to trusting too little.
The problem isn't just a missing warning label. The interface itself pushes against it. Samsonov argues that fluent grammar, confident tone, and polished formatting create a halo effect, and that chat interfaces make it worse by nudging you toward your next question instead of toward checking the last answer Does confident AI tone make users skip fact-checking?. A disclaimer sits on top of an output that looks authoritative in every other way. That may explain why blanket caution works like a blunt tool. It lowers trust across the board instead of pointing at the parts of an answer that actually deserve doubt.
This pattern has a twin on the model side. Research on AI agents that must keep secrets for one party in a multi-party setting found that prompting, distillation, and RL all slide models along the same tradeoff curve between leaking and over-refusing, and none of them gets past it Can training methods escape the leak versus over-refusal tradeoff?. Read next to the reliance study, it suggests something broader: when a single caution setting governs every case, you can choose where on the curve to sit, but you can't escape the tradeoff. To get out of it, the signal probably has to depend on the specific answer, the task, or the user, not on a generic warning.
Design practice offers hints about what targeted signals might look like. Red Hat's PatternFly guidelines treat refusals as a UX writing problem. They favor partial compliance, a clear explanation, and a redirect over a flat 'no' Can AI refusals become better user experiences than compliance?. Following the same logic, a good disclaimer might say *which part* of an answer is shaky rather than hedging the whole thing. Work on advertising inside LLMs makes a related point from the regulatory side. Disclosure can be judged by which conversational norms it breaks or respects, such as being informative without being misleading Can Grice's maxims explain LLM advertising conflicts?. In that view a disclaimer is part of the conversation, and the question is whether it helps the reader. Being present isn't enough. One caution: whatever triggers the signal has to be fair. GPT-3.5's guardrails fire at different rates depending on the user's apparent age, gender, and ethnicity Do AI guardrails refuse differently based on who is asking?. Adaptive warnings could quietly bring that unevenness into reliance design.
The takeaway you may not have expected: the main obstacle isn't writing a better warning. 'Appropriate reliance' comes down to two errors you can trade against each other, and most interventions just pick a different point on that trade. The corpus suggests that beating it takes signals tied to the specific answer and task. It hasn't yet shown a disclaimer design that does this reliably.
Sources 6 notes
Three interventions tested on 400 participants cut over-reliance on GPT-4o across tasks, but pushed people toward rejecting advice they should have followed. Only one intervention reduced both over- and under-reliance, and only on one task type.
Samsonov argues that AI's confident tone, correct grammar, and polished formatting create a halo effect that makes users trust accuracy without verification. The chat interface compounds this by offering no accuracy warnings and actively prompting users toward new questions instead of source-checking.
Prompting scaffolds, distillation, and RL all move models along the same Pareto frontier without crossing it. Five experimental controls show this is structural: RL increases harm from the best checkpoint, apparent workarounds vanish under replication, and data scaling moves in the wrong direction.
Red Hat's PatternFly guidelines argue that partial compliance, transparent explanation, and redirection reduce frustration better than direct refusals. They extend this to streaming with chunk-based verification to prevent confusing mid-stream content deletion.
A framework classifies seven advertising conflict scenarios by which conversational maxims they violate, linking each violation to existing FTC enforcement standards on deception, disclosure, and unfair practices.
Show all 6 sources
GPT-3.5 refuses requests at different rates for younger, female, and Asian-American personas, and sycophantically declines to engage with political positions users would disagree with. Sports fandom and other non-political signals also shift refusal sensitivity.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- The Decision to Verify: How Warmth and User Characteristics Shape Reliance on Conversational Agents for Information Search
- Towards Training-time Mitigations for Alignment Faking in RL
- Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interest
- AI Chatbots Discourage Error Checking
- Whose Side Is Your Agent On? Multi-Party Principal Loyalty in LLM Agents
- ChatGPT Doesn’t Trust Chargers Fans: Guardrail Sensitivity in Context
- To Rely or Not to Rely? Evaluating Interventions for Appropriate Reliance on Large Language Models
- Seeing to Think? How Source Transparency Design Shapes Interactive Information Seeking and Evaluation in Conversational AI