Can a quorum of validators really provide independent judgment?
If multiple validators share training data, prompts, evidence sources, or infrastructure, their agreement may reflect shared causes rather than independent confirmation. This could make quorum-based systems less reliable than they appear.
The Honest Quorum Problem (2607.16109) does not stop at saying one validator can be wrong. It says several validators can be wrong for the same reason. The abstract lists what agentic validators "may share": model weights or lineage, training distributions, prompts, retrieval sources, toolchains, evidence, reasoning scaffolds, and provider infrastructure. The result, in the paper's phrase, is correlated epistemic faults, and the practical upshot is that a quorum's votes need not be independent.
The list is worth reading as a list. Model family, the axis most multi-model designs diversify, is the first item and the most visible one. The other seven are quieter and are usually chosen once for the whole system: one prompt template, one retrieval index, one tool wrapper, one cloud region. The paper's own example shows how ordinary this is. The validators there "inspect the same canonical request, state snapshot, policy context, and evidence package." Even validators built on different models would share that last item, so a misleading evidence package is a common cause by construction.
Why correlation matters more for a quorum than for a single reasoner is this note's reading, not something the excerpt spells out. A quorum threshold counts faults: it tolerates up to some number of bad participants and relies on any two quorums overlapping in a good one. A shared cause turns that count into an event. One flawed policy summary, one blind spot in a training distribution or one bad retrieval hit can push many validators the same way at once, and the votes that result look like independent confirmation while adding little beyond the first. Agreement then measures how alike the validators are, which is why Can a quorum of honest validators certify an invalid transition? cannot be solved by raising the quorum threshold alone. The coordination-defence work meets the same confound from the other side: How do we tell coordination apart from shared causes? says agents behaving alike may share a model, instructions or environment and not influence one another, and validators voting alike may likewise share a cause and not confirm one another.
This is the failure side of two vault findings about diversity. Can models trained on many imperfect experts outperform everyone? makes uncorrelated biases an explicit condition for aggregation to help: majority voting denoises only when the errors are diverse rather than correlated. Can a panel of smaller judges outperform one large judge? gets its gain by drawing judges from disjoint families, which addresses the weights-and-lineage and training-distribution channels. The Honest Quorum list says that is two of eight; prompts, retrieval, evidence, scaffolds and infrastructure can still be common.
The claim is conditional. The paper says validators may share these things, and the excerpt gives no measurement of how strongly any channel correlates faults in practice. That gap is the subject of Does model diversity actually reduce validator agreement failures?.
What the excerpt does not give. No correlation estimates, no experiment, and no statement of how the paper's thresholds account for correlation. Only the list of shared elements and the conclusion that faults are correlated are in the excerpt.
Inquiring lines that read this note 11
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How can multi-agent debate prevent false consensus on errors?- Does semantic validity across a quorum require new property definitions?
- Why does validator consensus solve agreement but not answer correctness?
- Which shared channels cause the strongest correlated validator failures?
- How do shared training distributions create correlated faults in validator agreement?
- How do false endorsements and unusable support bound validator consensus properties?
- How much do shared prompts and evidence channels correlate validator outputs?
- Does increasing quorum threshold fix agreement without semantic correctness?
Related concepts in this collection 7
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can a quorum of honest validators certify an invalid transition?
When validators follow the protocol perfectly but lack semantic understanding, can they collectively approve a state change that violates application invariants? This matters because it reveals a gap between protocol correctness and execution safety.
the problem this note explains the difficulty of: agreement among correlated validators is weak evidence of validity
-
Can models trained on many imperfect experts outperform everyone?
Can generative models trained on diverse, biased experts achieve better performance than any individual contributor? This explores whether aggregating diverse perspectives during training acts as implicit denoising.
the positive case: aggregation works when errors are uncorrelated; this note is what happens when they are not
-
Can a panel of smaller judges outperform one large judge?
Does aggregating votes from multiple smaller language models across different families produce better evaluations than relying on a single large model like GPT-4? This matters because evaluation cost and bias directly affect the reliability of AI-generated content assessment.
disjoint model families handle two of the eight channels; the rest survive a family-diverse panel
-
Does confidence drive influence in multi-agent deliberation systems?
When multiple AI agents deliberate together, does the agent who sounds most confident gain the most influence over the group's final answer? Understanding this matters because it determines whether consensus reflects actual competence or just persuasive miscalibration.
another route to a misleading consensus, through influence dynamics rather than shared upstream inputs
-
Does model diversity actually reduce validator agreement failures?
Using different AI model families is the cheapest way to reduce correlated errors among validators. But shared prompts, evidence sources, and infrastructure may keep their mistakes aligned regardless of model choice.
the open question this note leaves
-
How do we tell coordination apart from shared causes?
When two agents behave the same way, it could mean one influenced the other or both responded to the same external pressure. What evidence would actually separate these two cases?
the same inference problem on the monitoring side: similar behavior from a shared cause versus from influence, with shared model, instructions and environment as the named causes
-
Can individual components pass safety checks if the system still fails?
Explores whether local validation at each step—alignment checks, protocol compliance, plausibility tests—can guarantee safety when components are composed into larger workflows. Why the gap between component-level assurance and system-level outcomes matters for AI safety.
the wider shape this note is one reason for: adding validators leaves the gap in place when their errors are not independent, and the other mechanisms in that pattern leave it in place for different reasons
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- The Honest Quorum Problem: Epistemic Byzantine Fault Tolerance for Agentic Infrastructure
- When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMs
- Psychologically Enhanced AI Agents
- A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?
- Deep Think with Confidence
- Can AI Agents Agree?
- Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate
- Consensus is Strategically Insufficient: Reasoning-Trace Disagreement as a Knowledge-Representation Signal
Original note title
correlated epistemic faults — agentic validators can share weights or lineage training distributions prompts retrieval sources toolchains evidence reasoning scaffolds and provider infrastructure