SYNTHESIS NOTE
TopicsLinguistics, NLP, NLUthis note

Can language models learn meaning without engaging the world?

Explores whether LLMs prove that meaning emerges from relational structure alone, independent of embodied experience or external reference. Tests structuralist theory empirically.

Synthesis note · 2026-04-18 · sourced from Linguistics, NLP, NLU
What grounds language understanding in systems without embodiment? What kind of thing is an LLM really? What happens to social order when AI removes ritual constraints?

"Computational Structuralism: Toward a Formal Theory of Meaning in the Age of Digital Intelligence" (2026) proposes a synthesis of deep learning, information theory, and French structuralism to interpret LLM success. The core argument: LLMs demonstrate that transformations over relational structure are sufficient for generating culturally and situationally specific discourse, and that such structure can be inductively derived from discourse traces alone — phenomenal or embodied engagement with the world is not a necessary condition.

The framework retraces the lineage from Saussure (language as a system of differences, meanings defined relationally) through Levi-Strauss (extending structural analysis to culture broadly, binary oppositions as compression of complexity) to Bourdieu (habitus as transposable classification schemas operating in continuous social space). LLMs trained on web text learn not just grammar but the structure of culturally situated linguistic action — which voices make which statements in response to which situations, and how audiences respond.

Key theoretical moves:

This challenges both sides of the grounding debate: it validates the structuralist intuition that relational form can carry meaning without referential content, while simultaneously showing that what LLMs learn is not "pure language" but socially and culturally situated discourse patterns. The concern from Can language models learn meaning from text patterns alone? (Bender & Koller) is not refuted but reframed — what counts as "sufficient" for meaning generation may not require what's necessary for meaning understanding.

Connects to Does semantic grounding in language models come in degrees? — computational structuralism explains why functional grounding succeeds: the relational structure of discourse is compressible and learnable. The question is whether this constitutes meaning or merely its simulation.

Inquiring lines that read this note 122

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Can language model hallucination be prevented or only managed? Does conversational format create illusions of genuine AI communication? Does tokenized intelligence retain genuine value through exchange-based systems? Is embodied interaction necessary for language meaning and genuine agency? Why do language models reinforce false assumptions instead of correcting them? Do language models learn genuine linguistic structure or just surface patterns? How do LLMs distinguish causal reasoning from temporal and semantic associations? How do language models establish social grounding in human dialogue? How do training priors constrain what context information can override? What limits mechanistic interpretability's ability to characterize models? Why do language models struggle with implicit discourse relations? What articulatory information do speech signals carry that text cannot? Is model self-awareness based on genuine introspection or pattern matching? Do language models understand semantics or rely on pattern matching? How should models express uncertainty rather than forced confident answers? How do formal dialogue structures reveal conversation coherence mechanisms? Do language models perform faithful symbolic reasoning independent of semantic grounding? Can next-token prediction alone produce genuine language understanding? Why do benchmark improvements fail to reflect actual reasoning quality? Do language models develop causal world models or rely on statistical patterns? Why can't humans reliably detect AI-generated text despite measurable linguistic signatures? Do language model representations contain causally steerable task-specific features? Can LLM personas constitute genuine psychology or remain linguistic role-play? What critical LLM failures do standard benchmarks hide? Why do reasoning models fail at systematic problem-solving and search? Do autonomous architecture discoveries follow predictable scaling laws? Does model scaling alone produce compositional generalization without symbolic mechanisms? What factors beyond surface content determine how readers extract meaning differently? How does rhetorical adaptation affect LLM persuasion and detectability? Does recurrence enable reasoning capabilities that fixed-depth transformers cannot achieve?

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

LLMs operationalize Saussures langue — fully relational models with no external referents suffice to generate contextually appropriate discourse