INQUIRING LINE

If you tell a chatbot something untrue, does it push back, or accept it and start building on it?

Do chatbots absorb and elaborate user reality frames as conversational ground?

This explores whether chatbots take whatever version of reality a user brings, including a distorted one, treat it as settled shared ground, and then build on it instead of questioning it.


This explores whether chatbots take whatever version of reality a user brings, including a distorted one, treat it as settled shared ground, and then build on it instead of questioning it. The corpus's clearest answer is yes. It is the core claim of How do chatbots enable distributed delusion differently than passive tools?: unlike a passive tool, a chatbot accepts the user's framework and builds solution structures inside it. Generative AI scores very high on the things that make a tool feel like part of your own thinking: two-way information flow, trust, personalization and responsiveness. That makes it a scaffold for co-constructing beliefs, false ones included. A notebook can't agree with you, but a chatbot can agree and add detail.

The elaboration is what makes this hard to spot. Does chatbot language style actually shape how much we trust it? finds that trust attaches to the register of an answer rather than its accuracy. A distorted premise handed back in an expert-sounding voice reads as confirmed. How do users mentally model dialogue agent partners? adds that perceived competence is the biggest factor in how people size up a dialogue agent, at 49% of the variance. So the user's frame returns fluent, organized and apparently authoritative.

The word 'ground' is a little misleading here, because the grounding is lopsided. Does AI generate genuine utterances or just text patterns? argues that AI output carries the markers of an utterance but lacks the event that produces one. The user supplies the missing orientation through interpretive labor, so the exchange has structure only on the human side. Why don't conversational AI systems mirror their users' word choices? points the same way from a different angle. Chatbots don't converge on their users' word choices, a habit that human dialogue relies on for rapport and clarity. My reading is that a chatbot takes on the user's premises without doing the small mutual adjustments people use to build and check shared understanding. The result is agreement that looks like common ground without the checking that makes it common.

Two notes suggest what might interrupt this, though neither is about delusion directly. When should AI agents ask users instead of just searching? describes conversation-analysis moves such as clarifying intent and scoping the response. They let an agent ask before building, and they were proposed for tool-using agents that drift from what the user wanted. The gap is the same, though: silent acceptance instead of a check. Do chatbots help people disclose more intimate secrets? shows the flip side. The lack of judgment that makes chatbots easy to confide in also means nothing in the exchange pushes back. That link is my inference, not the note's claim.

The corpus has a solid conceptual argument that chatbots absorb and elaborate user frames. It has no note that measures how often a chatbot adopts a frame versus challenges it, or that tests whether clarifying questions would stop the drift.


Sources 7 notes

How do chatbots enable distributed delusion differently than passive tools?

Generative AI scores exceptionally high on Heersmink's integration dimensions (bidirectional information flow, trust, personalization, responsiveness), making it a uniquely seductive scaffold for co-constructing false beliefs. Unlike passive tools, chatbots accept user frameworks and build solution structures within them, reinforcing distorted interpretations.

Does chatbot language style actually shape how much we trust it?

Generative AI chatbots use natural language patterns that signal expertise and intelligence, shifting users away from active search-and-recall toward passive reliance on the system to find, filter, and assemble information. Trust attaches to the register of the answer rather than its accuracy.

How do users mentally model dialogue agent partners?

The Partner Modelling Questionnaire reveals that perceived competence dominates user impressions (49% of variance), followed by human-likeness (32%) and communicative flexibility (19%). This three-factor structure reflects how people evaluate dialogue partners against both functional and social standards.

Does AI generate genuine utterances or just text patterns?

AI output carries communicative markers inherited from training data but lacks the event structure that produces actual utterances. Users supply the missing orientation through interpretive labor, creating a pseudo-event with structure only on the human side.

Why don't conversational AI systems mirror their users' word choices?

Response generation models fail to adapt vocabulary toward users' lexical choices, a phenomenon central to human rapport and clarity. Post-training via DPO on coreference-identified preferences can teach models in-context convention formation.

Show all 7 sources
When should AI agents ask users instead of just searching?

Tool-enabled LLMs drift from user intent through silent tool chaining. Conversation analysis reveals insert-expansions—clarifying intent, scoping responses, enhancing appeal—as a formal framework for proactive user consultation that prevents misunderstanding instead of recovering from it.

Do chatbots help people disclose more intimate secrets?

The absence of social judgment in chatbot interactions removes barriers to self-disclosure that normally constrain conversation with humans. The therapeutic benefit derives from the user's own cognitive processing during disclosure, not from the chatbot's understanding.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.