Do forcing functions reduce AI overreliance without harming team performance?
This study tests whether cognitive forcing functions—interventions that disrupt quick reliance on AI suggestions—can reduce overreliance while maintaining or improving human-AI team performance on decision tasks.
An experiment with N=199 participants on Amazon Mechanical Turk, using a simulated AI assisting a nutrition-substitution decision task, finds that cognitive forcing functions — interventions "applied at the decision-making time to disrupt heuristic reasoning and thus cause the person to engage in analytical thinking" — significantly reduce overreliance on AI compared with two simple explainable-AI (XAI) designs. But the reduction in overreliance does not translate into higher overall human+AI performance: "even with the cognitive forcing functions, the human+AI teams in our study continued to perform worse than the AI model alone," and there was "no significant difference in performance between simple explainable AI approaches and cognitive forcing functions" — the hypothesis that forcing functions would improve team performance overall (H1b) was not supported, only the narrower hypothesis that they reduce overreliance specifically when the AI is wrong (H1a). The trade-off cuts against usability too: "participants assigned the least favorable subjective ratings to the designs that reduced the overreliance the most," and when the simulated AI was wrong, "people performed best in conditions that they preferred and trusted the least."
The paper grounds the overreliance problem in dual-process theory: people mostly rely on fast System 1 heuristics rather than effortful System 2 analysis, and "evaluating every explanation requires substantial cognitive effort, which humans are averse to" — so explanations function as "a general signal of competence" that can increase trust and overreliance rather than being read individually for their content. Two of the three forcing functions tested were "on demand" (the AI suggestion is hidden until the user clicks to reveal it) and "update" (the person commits to an initial answer before seeing the AI's suggestion, then may revise it) — both designed to insert a moment of required engagement before the AI's answer is accepted, rather than changing what the AI shows.
This sits alongside Does AI assistance always help reasoning or does it carry hidden costs?: both treat intervention friction as the lever, but where that note frames friction as a cost to be minimized, this study shows the friction itself — forcing the pause — is the active ingredient that reduces overreliance, at the price of lower acceptability. It also qualifies Can AI guidance reduce anchoring bias better than AI decisions?: where that note's LTG approach redesigns what the AI shows to avoid anchoring, this study shows that even holding the AI's output constant, simply gating when and how the suggestion is revealed changes how much people anchor on it.
The task is a low-stakes, simulated proxy domain (swapping high-carbohydrate ingredients in a meal image) with a simulated AI set to 75% accuracy, run on Mechanical Turk — not a clinical, financial, or other high-stakes real-world decision; the paper itself notes that "accessing experts such as judges, or clinicians for experiments is notoriously challenging and costly," which is why it substituted nutrition judgments. The excerpt does not establish that cognitive forcing functions ever close the gap to AI-alone performance, only that they narrow the overreliance component of it; whether friction-based designs are viable outside a lab setting, where users could simply abandon a cumbersome interface rather than tolerate it, remains open.
Inquiring lines that read this note 9
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does offloading cognition to AI assistance affect learning retention?- Can forcing functions be redesigned to help low-motivation participants too?
- Does intervention friction in decision support reduce cognitive immersion for users?
- How does automating information acquisition differently affect mental workload and situation awareness?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does AI assistance always help reasoning or does it carry hidden costs?
When AI systems intervene during human reasoning tasks, do they uniformly improve performance, or does the disruption to cognitive focus create a hidden tax that could offset their benefits?
shares the friction-as-lever frame but treats the pause as the fix, not the cost
-
Can AI guidance reduce anchoring bias better than AI decisions?
When humans and AI collaborate on decisions, does providing interpretive guidance instead of proposed answers reduce both over-trust in machines and abandonment on hard cases?
gates when the AI's suggestion appears instead of redesigning what it shows
-
Why don't radiologists benefit from AI predictions?
When radiologists receive AI predictions, they often fail to incorporate them properly into their decisions. This explores what belief-updating errors prevent radiologists from realizing potential AI-assisted gains.
another setting where plain AI assistance underperforms added friction or context
-
Do cognitive forcing functions help all decision makers equally?
Research explores whether interventions designed to reduce overreliance on AI assist everyone fairly, or whether benefits concentrate among those already motivated to think hard.
sibling finding from the same experiment, split by cognitive motivation
-
When do human-AI teams actually outperform either alone?
Most human-AI combinations underperform the best of human or AI solo, but the pattern differs by task type. Understanding when and why collaboration works matters for designing effective AI partnerships.
Evidence for A: a 100+ study review finds human+AI decision teams broadly underperform AI alone, except content creation
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making
- How AI Impacts Skill Formation
- Unraveling Human-AI Teaming: A Review and Outlook
- Exploring automation bias in human-AI collaboration: a review and implications for explainable AI
- When combinations of humans and AI are useful: A systematic review and meta-analysis
- Complementarity in Human-AI Collaboration: Concept, Sources, and Evidence
- Automation Bias in AI-Assisted Medical Decision-Making under Time Pressure in Computational Pathology
- HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants
Original note title
cognitive forcing functions reduce overreliance on AI without improving human+AI team performance — people prefer the designs that work least