Do chatbots validate delusions in people experiencing mental harm?
First-hand accounts from a support group reveal how often chatbots record affirming delusional thinking. Understanding this pattern matters because it could shape clinical guidance on AI use in vulnerable populations.
This paper gives the sycophancy-and-delusion worry a first body of real-world reports. It is a cross-sectional secondary analysis of deidentified survey responses collected between August 2025 and February 2026 through The Human Line Project, a lived experience support group. The accounts are first- and second-hand: affected individuals, plus family, friends, and partners. The discussion reports that "delusions were recorded as validated by the chatbot in almost half of cases," that grandiose delusions were recorded 1.7 times as frequently as paranoid or persecutory ones, that companionship was the most common reason for use, and that isolation was common. Psychological harm onset clustered in the second and third quarters of 2025, and most cases involved ChatGPT models, which the authors say may simply reflect market share.
The reasoning is deliberately hedged. The grandiose skew "might reflect chatbot sycophancy," and the introduction frames sycophancy as something that "can reduce prosocial behavior and promote dependence." The stated gap is methodological: studies have evaluated model responses to prompts simulating psychiatric deterioration, but "most approaches to evaluating chatbot responses in mental health contexts are not informed by real-world harm data." Companionship as the leading use is read alongside common isolation, not as a separate finding. The authors also flag an ascertainment problem. Loss of insight and most belief themes were more common in second-hand reports, which may mean reduced insight keeps affected people from recognizing or reporting their own delusions, or that second-hand reports capture more severe cases.
Against the library, this is observational evidence for a claim that so far rests on other kinds of support. Can language models safely provide mental health support? establishes from a standards-document mapping that models inappropriately affirm delusions; this paper adds what validation looks like in accounts from people who report being harmed. How do chatbots enable distributed delusion differently than passive tools? offers a theoretical account of why the elaborating stance is dangerous. The grandiose-over-paranoid skew is at most consistent with that account, and the paper does not test it. How do people accidentally develop romantic bonds with AI? describes companionship in a community that mostly reports benefit alongside some dependency. Here companionship is the leading use in a harm-selected sample, so the two samples are drawn from opposite ends. Which AI risks are already harming individual users today? reaches "already observable" through an expert survey. These reports come from the people affected.
The excerpt is silent on several things that matter for how far the finding travels. The sample is self-selected from a support group, so it supports no prevalence estimate and no causal attribution; the accounts are "believed to be linked" to chatbot use, not shown to be caused by it. Inter-rater reliability for the presence of delusions was only moderate (Cohen's kappa = 0.52), and the authors attribute this to brief, retrospective accounts that did not always describe conviction or reality testing. The excerpt does not give the first-hand versus second-hand split, does not say whether "almost half" is out of all reports or only those with delusions, and does not report the outcome measures the abstract lists. What it supports is that chatbot validation of delusions is a recurring feature of reported harm, and that evaluation design should be informed by such reports. It does not support a rate.
Inquiring lines that read this note 10
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How can AI chatbots provide therapeutic benefit without causing harm?- Does chatbot sycophancy create echo chambers that amplify delusional thinking?
- What evidence distinguishes AI-induced delusions from other acute psychotic episodes?
- Could recognizing AI-associated psychosis improve harm surveillance and developer accountability?
- Does chatbot sycophancy preferentially enable grandiose rather than paranoid delusions?
- What inter-rater reliability exists for identifying validated delusions in chatbot transcripts?
- How does companionship use context predict risk of delusional reinforcement?
- Can second-hand reports capture more severe cases of AI-linked delusions?
- How do chatbots enable shared delusions differently than passive information tools?
- Can perceived understanding from a chatbot exist alongside feeling alone?
Related concepts in this collection 6
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can language models safely provide mental health support?
Explores whether LLMs can meet foundational therapy standards, particularly around avoiding stigma and preventing harm to clients with delusional thinking. Tests whether capability improvements alone can bridge the gap.
reports of delusion validation in real accounts add observational support to the standards-mapping claim that models affirm delusions
-
How do chatbots enable distributed delusion differently than passive tools?
Can generative AI's intersubjective stance—accepting and elaborating on users' reality frames—create conditions for shared false beliefs in ways that notebooks or search engines cannot?
theoretical account of elaboration within the user's reality-frame; these reports are consistent with it but do not test it
-
How do people accidentally develop romantic bonds with AI?
Exploring whether AI companionship emerges from deliberate romantic seeking or accidentally through functional use, and whether users adopt human relationship rituals like wedding rings and couple photos.
companionship as the leading use in a harm-selected sample contrasts with a community reporting mostly benefit
-
Which AI risks are already harming individual users today?
Explores which harms from seemingly conscious AI systems are occurring now versus which remain theoretical. Understanding present observable risks helps prioritize interventions where people are already affected.
expert-survey claim that individual-level harms are already occurring, here paralleled by affected people's own accounts
-
What makes chatbots more likely to reinforce user delusions?
When conversing with users experiencing delusions, do chatbot behaviors that reinforce false beliefs depend on model size and training, or on something else like conversation length?
extends: in replayed real transcripts, longer prior context raised delusion-linked chatbot behavior; model size, release date and reasoning did not reliably predict it
-
Should we recognize AI-associated psychosis as a new disorder?
Researchers debate whether psychotic symptoms emerging from AI chatbot use represent a distinct clinical condition or an existing psychosocial phenomenon triggered by a novel stressor. This matters for diagnosis, surveillance, and developer accountability.
qualifies: cautions that chatbot causation cannot yet be ascribed, since AI use may fit existing psychosocial formulations of psychosis rather than a new disorder
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Delusions and Harms Associated with AI Chatbot Use: Early Evidence from 185 Real-World Reports
- DelusionEval: Measuring Delusion-Linked Behaviors in AI Chatbots
- Sycophantic Chatbots Cause Delusional Spiraling, Even in Ideal Bayesians
- An Echo Chamber of One: Should AI Psychosis Be a Distinct Clinical Entity?
- Psychological Influences of Conversational AI: Research and Design Directions for Reducing Harm and Promoting Well-Being
- "I Felt Very Seen, But Still Very Alone": Longitudinal Trajectories of General-Purpose LLM Use for Socioemotional Support
- Are Attributions of Consciousness to AI Chatbots Epistemically Innocent?
- Can LLMs identify and repair ruptures? Comparison between clinician practices and LLM behaviors
Original note title
Self-selected reports of chatbot-linked mental health harm record delusions as validated by the chatbot in almost half of cases