SYNTHESIS NOTE
Topics›Linguistics, NLP, NLU›this note

Can language models learn meaning without engaging the world?

Explores whether LLMs prove that meaning emerges from relational structure alone, independent of embodied experience or external reference. Tests structuralist theory empirically.

Synthesis note · 2026-04-18 · sourced from Linguistics, NLP, NLU

"Computational Structuralism: Toward a Formal Theory of Meaning in the Age of Digital Intelligence" (2026) proposes a synthesis of deep learning, information theory, and French structuralism to interpret LLM success. The core argument: LLMs demonstrate that transformations over relational structure are sufficient for generating culturally and situationally specific discourse, and that such structure can be inductively derived from discourse traces alone — phenomenal or embodied engagement with the world is not a necessary condition.

The framework retraces the lineage from Saussure (language as a system of differences, meanings defined relationally) through Levi-Strauss (extending structural analysis to culture broadly, binary oppositions as compression of complexity) to Bourdieu (habitus as transposable classification schemas operating in continuous social space). LLMs trained on web text learn not just grammar but the structure of culturally situated linguistic action — which voices make which statements in response to which situations, and how audiences respond.

Key theoretical moves:

This challenges both sides of the grounding debate: it validates the structuralist intuition that relational form can carry meaning without referential content, while simultaneously showing that what LLMs learn is not "pure language" but socially and culturally situated discourse patterns. The concern from Can language models learn meaning from text patterns alone? (Bender & Koller) is not refuted but reframed — what counts as "sufficient" for meaning generation may not require what's necessary for meaning understanding.

Connects to Does semantic grounding in language models come in degrees? — computational structuralism explains why functional grounding succeeds: the relational structure of discourse is compressible and learnable. The question is whether this constitutes meaning or merely its simulation.

Inquiring lines that read this note 133

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

What causes hallucination and how can it be addressed? What conversation mechanics enable genuine human-AI communicative participation? How does AI writing assistance affect reader perception of writer authenticity? How does tokenizing intelligence reshape labor markets and institutional outcomes? How can we determine if computational systems are genuinely conscious? Do language models genuinely understand or primarily match statistical patterns? What distinguishes genuine understanding from correct linguistic performance? What reasoning limitations and biases do language models systematically exhibit? Do language models learn underlying linguistic structure or merely surface patterns? How do mechanistic features and representations drive model behavior? What conversational structures and patterns determine dialogue effectiveness and coherence? Can language models develop genuine communicative grounding with humans? Does learning articulatory physics explain speech communication superiority? Do language models truly understand their encoded knowledge or merely retrieve patterns? What explains the gap between LLM semantic understanding and production? Does chain-of-thought reasoning faithfully reflect actual model reasoning processes? Why doesn't LLM knowledge translate to improved reasoning outputs? Why do language models systematically fail at causal reasoning? What determines whether visible reasoning traces improve task performance? Can scaling alone produce compositional generalization in neural networks? What makes reasoning models struggle with ill-posed and unfamiliar problems? How can we distinguish genuine model self-knowledge from behavioral performance? What determines how neural networks organize their internal knowledge representations? How do transformer circuits and attention mechanisms enable or limit reasoning? Why do users believe false claims despite fact-checking efforts?

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

LLMs operationalize Saussures langue — fully relational models with no external referents suffice to generate contextually appropriate discourse