Do frontier LLMs actually explore the full space of valid answers?
When multiple correct answers exist, do advanced language models expose users to that full range, or do they collapse onto a narrow canonical subset? This matters for learning, inquiry, and decision-making.
The paper's starting point is that a model can be accurate and still "epistemically narrow": in contexts where alternatives would be useful, it "repeatedly presents only a few canonical routes despite the existence of multiple valid answers." The authors define epistemic diversity as the range of valid answers, explanations, examples, concepts, and reasoning strategies a model makes available to users. Operationalizing it across ten models and two datasets, they find that frontier LLMs "often exhibit epistemic narrowness, even when many valid alternatives exist." In the professions domain the models concentrate on a small set of canonical individuals; in the proofs domain they often return the same proof strategy although accepted alternatives exist.
The reasoning rests on how LLMs are now used: not only to predict but to answer questions, explain, teach, and support inquiry. In those settings what matters is also which answers and reasoning routes the model puts in front of the user. Accuracy cannot register the loss, because each answer a narrow model returns is valid; the narrowing shows up only when you ask how much of the valid space is covered. The paper therefore separates epistemic diversity from group-based diversity, which asks whether demographic, cultural, or political groups are represented or treated fairly. Epistemic diversity concerns "coverage over valid answer spaces or answer classes." The proposed framework asks what makes an answer valid, why multiple valid answers arise, and how diversity should be measured under different interaction protocols. The authors' conclusion is that models "do not merely answer questions, but shape which knowledge becomes salient."
Against the nearest notes, this is a coverage-of-valid-answers reading of a problem the vault already tracks as output homogeneity. Do different AI models actually produce diverse outputs? studies open-ended queries with no single ground truth; this paper's two domains are ones where accepted alternatives exist, so the narrowing is measured against a set of valid answers rather than against human variety. Does preference tuning actually reduce the diversity of model outputs? also gates diversity on quality, but asks how varied the passing outputs are, not how much of the valid space they reach. Why do LLMs generate novel ideas from narrow ranges? shows the same shape in a third setting, where individual quality coexists with a narrow collective range.
The excerpt is silent on much that would sharpen the claim. It does not name the ten models or the two datasets beyond their domains. It does not say how validity was determined, how narrowness was quantified, or how large the effect is. It does not say whether the concentration appears within one model across samples, across models, or both, so it cannot be set directly beside the hivemind finding. It offers no cause, such as training method or scale, and no human baseline. The framework is called preliminary, and only two domains are tested. What follows at that strength is modest: accuracy alone is an incomplete evaluation for knowledge-support uses, and coverage of valid answer spaces is a measurable candidate for the missing dimension.
Inquiring lines that read this note 1
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does evaluation scope and dimensionality affect what we measure?Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Do different AI models actually produce diverse outputs?
Explores whether using multiple different language models together creates genuine diversity or whether shared training and alignment cause them to converge on similar answers despite independence.
same homogeneity concern, measured on open-ended queries; this paper measures coverage of valid answers in professions and proofs
-
Does preference tuning actually reduce the diversity of model outputs?
The field assumes RLHF and DPO reduce diversity, but this assumption rests on measuring all outputs equally. What happens if we only count diverse outputs that meet quality thresholds?
also conditions diversity on quality, but measures spread among passing outputs, not coverage of the valid space
-
Why do LLMs generate novel ideas from narrow ranges?
LLM research agents produce individually novel ideas but cluster them in homogeneous sets. This explores why high average novelty coexists with poor diversity coverage and what it means for automated ideation.
the same narrow-range pattern in research ideas, alongside good individual outputs
-
Do language models flatten the range of public arguments?
When LLMs write essays on the same topics as humans, do they recover the full spectrum of distinct arguments and reasons people actually make, or do they narrow the deliberative space readers encounter?
Evidence for: LLM essays recover only about half of distinct human main arguments, so narrowing shows up in claims and reasons, not word choice
-
Where does mode collapse in language models really come from?
Researchers investigate whether mode collapse—when models narrow to repetitive outputs—stems from training algorithms or the preference data itself. Understanding the root cause is crucial for fixing diversity loss in creative and synthetic tasks.
Extends: traces post-training mode collapse to typicality bias in preference data and shows verbalized sampling restores diversity without training
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- On Epistemic Diversity in Large Language Models
- RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMs
- Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
- 100 Days After DeepSeek-R1: A Survey on Replication Studies and More Directions for Reasoning Language Models
- Eliciting Reasoning in Language Models with Cognitive Tools
- Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models
- Beyond the Last Answer: Your Reasoning Trace Uncovers More than You Think
- Reasoning LLMs are Wandering Solution Explorers
Original note title
frontier LLMs often show epistemic narrowness — they collapse large valid answer spaces onto small canonical subsets even when many valid alternatives exist