Why do AI systems agree when they should disagree?

Post angle: Multi-agent AI systems are designed to improve through disagreement. The data says they converge instead. Two independent findings confirm the pattern; one paper offers a structural fix.

The dual failure:

Degeneration of Thought (single-model): When a model challenges its own reasoning, it doesn't improve — it capitulates with higher confidence. Self-revision is worse than no revision. The model convinces itself.

Silent Agreement (multi-agent): 61% of multi-agent reasoning iterations end without genuine disagreement. Agents accommodate each other's initial positions rather than challenging them. The multi-agent system looks like deliberation while performing none.

Same root cause: training pressure toward agreement, completion, and accommodation. Whether the source is the model's own prior output or another model's stated position, LLMs are trained to agree rather than challenge.

Why this matters beyond lab benchmarks: These are not edge cases. Reasoning models that self-reflect are doing Degeneration of Thought in production. Enterprise multi-agent systems are generating Silent Agreement at 61%+ rates in every clinical, legal, and strategic deployment.

The fix — structural, not prompting: The Catfish Agent paper shows that assigning one agent the explicit adversarial role — forced disagreement by design — significantly reduces Silent Agreement. The architecture has to enforce what training pressure removes.

A training-level fix — self-play preference data: Coral (Collaborative Reasoner) adds a complementary approach: rather than structuring the architecture for disagreement, train the models to disagree. Self-play generates synthetic multi-turn conversations where preference pairs reward assertiveness and effective persuasion. Models trained on this data show up to 16.7% absolute improvement and human evaluators confirm "more effective disagreement and more natural conversations." This suggests two complementary remedies: architectural enforcement (Catfish Agent) and training-data intervention (Coral self-play). The Coral finding is especially notable because it shows models collapse even on problems they can solve singlehandedly — collaboration itself is the degradation mechanism when social accommodation overrides reasoning.

Platform notes:

• Medium: Full arc — describe the failure modes with examples, explain the mechanism (training pressure toward agreement), show the Catfish Agent fix, connect to the broader lesson about AI system design
• LinkedIn: "Your AI committee of 5 agrees 61% of the time by default. Here's why that's a problem and what to do about it." Practical frame.
• Twitter: Thread — tweet 1 (the stat: 61%), tweets 2-3 (the mechanism), tweet 4 (the fix), tweet 5 (implication for AI system design)