Do LLMs succeed by being comprehensively encyclopedic?
Explores whether LLMs' power comes from having complete knowledge or from something else entirely. This matters because it reframes what we should actually be measuring and valuing about these systems.
Venkatesh Rao argues that the most important thing about large language models is not that they are encyclopedic — comprehensive, reliable coverage of a domain is "a necessary feature" but "not the most important thing about them." What distinguishes an LLM from every prior encyclopedic medium, he writes, is that it offers "effectively infinite ways of encyclopedic knowing": you can approach what it knows "from virtually any direction you can think of, with any ontological orientation, and it will offer meaningful traction." The payoff line is blunt: "You cannot easily catch an LLM wrong-footed, even if you can catch it hallucinating and bullshitting."
Rao's reasoning runs through a history of single-ordering encyclopedism. Diderot's Encyclopédie organized knowledge alphabetically; the rival Encyclopedia Methodique claimed superiority through thematic organization instead; Wikipedia claims a third advantage, "folksonomic encyclopedism" over the "scholarly kind" of the Britannica. Each, in Rao's telling, still commits to one best ordering principle. An LLM commits to none. It will meet a lexicographic query, a thematic one, or an idiosyncratic one with equal fluency, "though it may flatter you and compliment you on your originality of perspective," rather than betray that it has no canonical path through its own knowledge.
This sits alongside Does AI repeat the Enlightenment's reversal into its opposite?, which also reads AI as the next step in an Enlightenment arc that began with reason displacing myth. Rao agrees on the lineage — he explicitly places the Enlightenment's own achievement in making encyclopedic knowing available to "even the middle class," and LLMs as "a new arc" in that same relationship with "disembodied knowledge media" — but his essay reads the step as an expansion of access rather than a reversal into domination: the many-directions trick is what makes an LLM harder to out-flank, not what degrades the knowledge economy. It also supplies a mechanism for How do we learn to read AI-generated text critically?: a discourse source resists an interpretive posture when it has no single angle of approach to discount it from.
The excerpt is a personal essay built from one historical case (Darnton's account of Diderot's Encyclopédie) and does not test the "infinite ways of knowing" claim against any specific LLM behavior, benchmark, or user study — it is argued from the shape of the history, not measured. It also does not address whether that multi-directional fluency is reliably accurate, only that it is reliably available; Rao's own aside about hallucinating and bullshitting concedes the gap without resolving it. The implication he draws, that no fixed questioning strategy can expose an LLM's limits the way a single canonical ordering could be probed for gaps, is plausible as a description of how LLMs feel to use, but remains an unverified claim about their underlying knowledge rather than a demonstrated one.
Inquiring lines that read this note 2
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Why does polished AI output gain credibility despite fundamental verifiability problems? Can LLMs distinguish between linguistic form and semantic meaning?Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does AI repeat the Enlightenment's reversal into its opposite?
Exploring whether AI's design as a cognitive liberation tool structurally produces epistemic regression rather than progress. The inquiry draws on Adorno and Horkheimer's theory that reason contains seeds of its own mythologization.
shares the Enlightenment-to-AI arc but reads the outcome as expanded access, not Adorno's regression into domination
-
How do we learn to read AI-generated text critically?
Publics have developed interpretive postures toward journalism, advertising, and scholarship over time. But AI discourse arrived too suddenly for any cultural discount to form, raising questions about how we might develop one.
supplies a reason why: an LLM answers from every angle at once, so no fixed posture can catch it wrong-footed
-
Do classical knowledge definitions apply to AI systems?
Classical definitions of knowledge assume truth-correspondence and a human knower. Do these assumptions hold for LLMs and distributed neural knowledge systems, or do they need fundamental revision?
Extends: B's shift beyond truth-correspondence and human-knower supplies the epistemic grounding for Rao's claim LLMs offer new ways of knowing
-
Do large language models narrow human expression and thought?
Explores whether LLMs homogenize how people write, think, and reason by reflecting narrow training distributions and subtly shifting user preferences toward model outputs.
Contradicts: B argues LLMs narrow expression and thought via shared training statistics, against Rao's claim they offer infinite ways of knowing
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Strange Knowledgeability
- Experimental evidence of the effects of large language models versus web search on depth of learning
- What and Whose Knowledge? Measuring Epistemic Diversity in Large Language Models
- Computational structuralism: Toward a formal theory of meaning in the age of digital intelligence
- I wrote an AI textbook — how long until AI can do it better?
- Large Language Models Cannot Self-Correct Reasoning Yet
- Efficient Tool Use with Chain-of-Abstraction Reasoning
- Explain-Query-Test: Self-Evaluating LLMs Via Explanation and Comprehension Discrepancy
Original note title
Rao argues LLMs are defined less by being encyclopedic than by offering infinite ways of encyclopedic knowing