SYNTHESIS NOTE
TopicsAgents Multi Architecturethis note

Does agent confidence actually signal competence in deliberation?

Multi-agent systems rely on confidence to route influence between agents, but confidence may not reflect true competence. This matters because miscalibrated confidence could systematically mislead group decisions.

Synthesis note · 2026-06-03 · sourced from Agents Multi Architecture

Multi-agent deliberation succeeds or fails not only on individual agents' predictions but on how they communicate and update. Modeling deliberation through Friedkin-Johnsen opinion dynamics — a tractable account of stubbornness, influence, and opinion change — yields a clean reframe: because the FJ parameters are input-dependent, deliberation behaves as a mixture of experts with adaptive routing. That explains when a multi-agent system beats single agents and static ensembles: when routing actually reflects agent competence on the input.

The problem is that competence is latent. In practice influence is established through observable proxies — an agent's self-assessed confidence, its perceived confidence, and its initial alignment with others. None of these is competence. So the routing that gives multi-agent systems their theoretical advantage is driven by the wrong signal, and miscalibrated confidence becomes influence. The paper names the resulting limitations precisely: miscalibrated agent confidence, misleading consensus, and routing errors.

This sharpens the vault's existing multi-agent failure cluster. Since Why do multi-agent LLM systems converge without genuine deliberation?, the FJ/MoE lens supplies the mechanism: agents route influence toward whoever sounds most confident, and consensus forms around persuasion rather than evidence — exactly the pattern When does debate actually improve reasoning accuracy? documents. The design implication is calibration-first: a multi-agent system is only as good as its agents' confidence is honest.

Inquiring lines that read this note 1

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Can model confidence signals reliably improve reasoning quality and calibration?

Related concepts in this collection 3

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
12 direct connections · 69 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

multi-agent deliberation is a mixture of experts whose routing tracks confidence not competence so miscalibration manufactures misleading consensus