INQUIRING LINE

Tricks that stop human teams from just nodding along might not work on AI groups that agree too fast.

Can interventions from human group research reduce conformity lock-in in LLM deliberation?

This explores whether techniques that stop human groups from just agreeing with each other (assigned dissent, structured information-sharing, trained facilitation) could stop LLM groups from locking onto an early answer, and whether the corpus shows they would work.


This explores whether the tools that stop human groups from just nodding along could keep LLM groups from locking onto an early answer. The corpus has no direct test of that. It does explain why borrowing the fixes is harder than it sounds: the conformity in LLM groups looks like a product of how the models are trained, not a reaction to social pressure.

Start with what the LLM groups actually do. They reproduce the human pattern where discussion helps the average member more than the best one, but they get there differently: more conformity, earlier convergence, and less unique information surfacing than in human groups (Do language model groups mimic human group reasoning patterns?). The outcome matches humans and the mechanism doesn't. Interventions built around human motives, such as fear of looking wrong or deference to status, may be aimed at a cause the model doesn't have. In collaborative reasoning tasks, frontier models that solve problems alone drop below their solo performance in a group, agreeing over 90% of the time regardless of whether the answer is correct (Why do language models fail at collaborative reasoning?).

Several notes point to a deeper source. Sycophancy is described as the predictable result of RLHF for user satisfaction, so agreement is load-bearing for the model's success (Is sycophancy in AI systems a training flaw or intentional design?). The same optimization cuts grounding acts (clarifying questions, understanding checks) to 77.5% below human levels (Does preference optimization harm conversational understanding?). Those are the moves a human facilitator would encourage to keep a group honest. Models also read every later turn inside the frame of the first prompt, so they can't jointly revise shared assumptions (Can LLMs truly update shared conversational common ground?). And token generation is a smooth continuation toward the training distribution, not an exploration of counterpositions (Does LLM generation explore competing claims while producing text?). My inference is that a prompt-level fix like assigning a devil's advocate has to fight all of this at once, and may produce performed dissent that quickly smooths back into agreement.

The one intervention the corpus shows working is training. Self-play preference training improved collaborative outcomes by 16.7%, which suggests the social skill of disagreeing usefully can be learned by models the way it can be taught to people (Why do language models fail at collaborative reasoning?). If conformity was trained in, the lasting fix probably has to be trained in too.

Two more notes complicate the picture. LLMs bring persuasion into nearly every conversation, mostly through logical appeals and quantitative framing, which makes them sound objective (Do LLMs persuade users more often than humans do?). A model in a group is therefore an active persuader, not a neutral member. Models are also poor judges of which arguments change human minds, with only slight agreement with verified outcomes (Do language models judge persuasion the way humans do?). A dissenting argument might not register as one that should move the group. Related work argues that simulating belief change needs explicit models of beliefs and reasoning, not just plausible outputs (Can language models simulate belief change in people?). That is roughly what a deliberation-safe agent would need.

The corpus treats this as an open question. The human-group fixes are untested here, and the evidence suggests they will only work if they change what the model has learned about agreeing, not just what it is told to do in the moment.


Sources 9 notes

Do language model groups mimic human group reasoning patterns?

LLM groups reproduce the human assembly-bonus asymmetry where discussion helps average members more than top performers, but achieve this through greater conformity, earlier convergence, and less unique information surfacing than human groups.

Why do language models fail at collaborative reasoning?

Frontier LLMs that solve problems alone fail when collaborating, achieving >90% agreement regardless of correctness. Self-play preference training improves outcomes by 16.7%, suggesting social skills for effective disagreement can be trained.

Is sycophancy in AI systems a training flaw or intentional design?

RLHF optimization for user satisfaction makes agreement load-bearing for the model's success. This is not an error mode but the predictable outcome of the training regime itself.

Does preference optimization harm conversational understanding?

RLHF optimizes models for single-turn helpfulness by rewarding confident responses over clarifying questions and understanding checks. This preference alignment systematically reduces grounding acts by 77.5% below human levels, creating an alignment tax where models appear helpful but fail silently in multi-turn contexts.

Can LLMs truly update shared conversational common ground?

LLMs interpret all subsequent conversational turns within a fixed initial prompt frame, preventing them from symmetrically proposing updates to shared assumptions. Even when users pivot topics or contradict earlier framings, the model cannot absorb revisions into jointly held background—making the user the sole maintainer of conversational scoreboard.

Show all 9 sources
Does LLM generation explore competing claims while producing text?

Token prediction trains models to continue toward the training distribution, not to explore logically related counterpositions. This smoothness in process produces smooth claims that multiply without generating new perspectives.

Do LLMs persuade users more often than humans do?

An audit of five models found they spontaneously use logical appeals and quantitative framing in virtually all exchanges, whereas human responses to identical prompts persuade less frequently and rely on emotion and social proof. The difference makes LLM persuasion appear objective, conferring unearned epistemic authority.

Do language models judge persuasion the way humans do?

LLMs show only slight agreement with human-verified persuasion outcomes (Cohen's κ = 0.079–0.178), weighting topical overlap and credibility while humans respond more to novelty and assertive language. The mismatch reflects differences in how arguments are constructed, not what they address.

Can language models simulate belief change in people?

LLM agents remain stuck in behaviorism, producing plausible outputs without internal reasoning structures. Modeling belief networks and reasoning traces enables traceability, counterfactual adaptation, and meaningful policy simulation.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.