Does time pressure make AI advice more persuasive to experts?
When pathologists work under time constraints, does pressure to decide quickly make them more likely to trust and act on AI recommendations, even when those recommendations are wrong?
In a web-based experiment with 28 trained pathology experts estimating tumor cell percentage on H&E-stained slides, AI integration gave a statistically significant rise in overall performance and also a 7% automation bias rate, in which "initially correct evaluations were overturned by erroneous AI advice." That 7% is the authors' own measurement, which they set against the 6% to 11% acceptance rates they cite from Goddard et al. Time pressure did not change how often automation bias occurred, but it appeared to raise its severity: heavier reliance on negative system consultations and a sharper performance decline.
The authors define automation bias as treating "automated cues as infallible," and count it only as commission errors: the independent estimate matched ground truth, and both the AI advice and the AI-aided estimate were wrong. Their proposed mechanism for time pressure is strain on cognitive resources, which increases alignment with AI advice, "beneficial when the AI is accurate, but detrimental when the system errs." The complicating result is that pathologists were "largely unwilling to adopt model recommendations" that contradicted their own judgments, so the authors suggest automation bias "may not be the primary cognitive bias" in this setting. The first hypothesis is fully accepted; the second is accepted only for severity.
This sits against Why do patients distrust medical AI systems?, which locates resistance on the user side, in beliefs about what AI can do. Here the expert resistance was real, but the costly failure ran the other way, through agreement with wrong advice. The rating study in Can clinicians tell GPT-4 advice apart from expert advice? judged AI output by perceived quality; this paper measures what clinicians do with it, and together they suggest that judging AI output on its face is a weak safeguard. The cost also appears faster than in Does AI assistance weaken our brain's ability to think independently?, which tracks a cost building over months; here it shows within one session.
The excerpt does not establish a clinical error rate. The sample is "modest" (28 experts, with few automation bias incidents), so the non-significant frequency effect is weak evidence that time pressure does not matter. Time pressure was simulated as a condition rather than a countdown, and the omitted clinical background may have made participants less diligent than in routine work. The task was one visual estimate on 20 patches from public datasets, with AI advice from an FCOS-based detector. The supportable claim is narrower than a prevalence figure: under these conditions AI advice can induce a measurable error, and time strain makes that error more damaging. Whether time pressure raises the frequency of automation bias in clinical practice would need field data.
Inquiring lines that read this note 3
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do clinicians calibrate trust in AI medical recommendations?Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can clinical experts teach LLMs to annotate complex medical concepts?
Clinical experts can manually identify complex medical concepts in patient notes, but transferring that expertise to LLM-based extraction systems proves difficult. Understanding where this transfer breaks down could improve how AI tools support expert workflows.
same clinical-expert setting; that note's barriers sit in AI replicating expert annotation, this one in what follows once AI output enters a decision
-
Can clinicians tell GPT-4 advice apart from expert advice?
This study explores whether trained clinicians can distinguish AI-generated psychological advice from expert advice, and how they rate the quality and empathy of each. The question matters for understanding whether AI might reliably supplement human expertise in mental health settings.
that study judges AI output by perceived quality; this one measures behavior and shows perceived quality is a weak safeguard
-
Why do patients distrust medical AI systems?
Explores the psychological barriers that make patients reluctant to adopt medical AI, beyond whether the technology actually works. Understanding these barriers is critical for designing AI systems patients will actually use.
contrast: user resistance rests on beliefs about capability; here experts resisted contrary advice yet still adopted erroneous AI advice
-
Does AI assistance weaken our brain's ability to think independently?
Can using language models for cognitive tasks reduce neural connectivity and learning capacity? New EEG evidence tracks how external AI support may systematically degrade our cognitive networks over time.
shared concern with AI-induced cognitive cost; this one appears within a single session and under time strain
-
How much does wrong AI advice harm radiologist accuracy?
When mammography radiologists receive incorrect AI suggestions labeled as system output, how much does their diagnostic accuracy decline? This matters for understanding automation bias in clinical workflows.
Evidence for A's automation-bias finding in another expert field: wrong AI BI-RADS suggestions cut experienced radiologists' accuracy from 82% to 45.5%
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Automation Bias in AI-Assisted Medical Decision-Making under Time Pressure in Computational Pathology
- Do as AI say: susceptibility in deployment of clinical decision-aids
- Automation Bias in Mammography: The Impact of AI BI-RADS Suggestions on Reader Performance
- Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology
- How AI Can Degrade Human Performance in High-Stakes Settings
- People Overtrust AI-Generated Medical Advice despite Low Accuracy
- Epistemic Deference to AI
- Learning To Guide Human Experts Via Personalized Large Language Models
Original note title
erroneous AI advice overturned correct tumor cell percentage estimates in 7% of AI-assisted assessments — time pressure raised severity, not frequency