Can language models learn meaning without engaging the world?
Explores whether LLMs prove that meaning emerges from relational structure alone, independent of embodied experience or external reference. Tests structuralist theory empirically.
"Computational Structuralism: Toward a Formal Theory of Meaning in the Age of Digital Intelligence" (2026) proposes a synthesis of deep learning, information theory, and French structuralism to interpret LLM success. The core argument: LLMs demonstrate that transformations over relational structure are sufficient for generating culturally and situationally specific discourse, and that such structure can be inductively derived from discourse traces alone — phenomenal or embodied engagement with the world is not a necessary condition.
The framework retraces the lineage from Saussure (language as a system of differences, meanings defined relationally) through Levi-Strauss (extending structural analysis to culture broadly, binary oppositions as compression of complexity) to Bourdieu (habitus as transposable classification schemas operating in continuous social space). LLMs trained on web text learn not just grammar but the structure of culturally situated linguistic action — which voices make which statements in response to which situations, and how audiences respond.
Key theoretical moves:
- LLMs operationalize Saussure's concept of langue — not the set of all valid statements, but the system that can interpret and generate all valid statements
- Language modeling is equivalent to text compression: removing redundancies by replacing them with generative principles. The same statistical dependencies that inform prediction compose the compressed model
- The framework privileges sufficiency over necessity — LLMs drawing on the same operations as humans is not claimed, but one way to achieve fluent natural language is now formally demonstrated
- Mechanistic interpretability offers the possibility of reverse-engineering these latent structures, answering structuralist questions (how are ideologies composed from simpler features?) with empirical methods
This challenges both sides of the grounding debate: it validates the structuralist intuition that relational form can carry meaning without referential content, while simultaneously showing that what LLMs learn is not "pure language" but socially and culturally situated discourse patterns. The concern from Can language models learn meaning from text patterns alone? (Bender & Koller) is not refuted but reframed — what counts as "sufficient" for meaning generation may not require what's necessary for meaning understanding.
Connects to Does semantic grounding in language models come in degrees? — computational structuralism explains why functional grounding succeeds: the relational structure of discourse is compressible and learnable. The question is whether this constitutes meaning or merely its simulation.
Inquiring lines that read this note 133
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What causes hallucination and how can it be addressed? What conversation mechanics enable genuine human-AI communicative participation?- Can secondary orality exist without any embodied human participant at all?
- How does training data preserve communicative event structure without the actual events?
- How does monological training on text differ from dialogical training in conversation?
- Can a virtual instance be individuated from its conversational context?
- Can we develop competent reading practices for disembodied orality?
- How can structurally different text produce equivalent real-world effects?
- Can knowledge flow without an embodied carrier transmitting it?
- How does Peircean Secondness differ from what RLHF actually provides?
- Can language about model behavior ever be accurate without anthropomorphic framing?
- Can understanding language happen entirely within a language system alone?
- Can functional behavior alone capture what makes something a genuine belief?
- Why does conceptual priming alone fail to produce consciousness claims?
- What makes the Extended Mind thesis incompatible with internalism?
- Does computational functionalism require an experiencing agent to ground symbols?
- How do single-ordering encyclopedic systems limit ways of knowing?
- Do language models raise validity claims in the Habermasian sense?
- Can a relational entity bear psychological properties the way Chalmers claims?
- Can LLMs participate meaningfully in discourse without consciousness or understanding?
- What structural limits prevent LLMs from abstracting moral principles?
- Can LLMs identify implicit metaphoric mappings that require pragmatic inference?
- Why do language models reproduce human EPA structure despite different architecture?
- What role does the biological substrate play in human relational identity?
- Does LLM vocabulary become the cultural lexicon for how we think?
- Can you separate grammatical competence from rhetorical commitment in language systems?
- Why does frame-activation matter more than word-by-word composition?
- How does enactive theory define language differently than computational linguistics?
- Can linguistic agency exist without embodiment and real-world participation?
- What makes a relational act different from just moving content around?
- What makes linguistic agency impossible for systems without embodiment?
- Can frame semantics explain why context matters more than word similarity?
- Does selective suppression of linguistic relations enable human meaning-making?
- What structural signals in user language reveal their unstated preferences and context?
- What role does language play as a cognitive scaffold versus communication tool?
- Does embodiment matter for genuine linguistic agency?
- What role does joint attention play in how humans learn language meaning?
- Can language meaning emerge without joint attention and shared embodied interaction?
- How does embodiment affect whether LLMs can participate in Wittgensteinian language games?
- What does embodiment and precariousness mean for linguistic agency?
- Why does joint attention matter for acquiring linguistic meaning?
- How do static embeddings and contextualized representations divide semantic labor?
- How does subject-predicate distinction emerge from formal linguistic analysis?
- Can pragmatic competence emerge from text exposure alone without interactive grounding?
- Does language convey meaning purely through relational structure without external grounding?
- Can readers detect meaning through resonance patterns alone without knowing authorial intent?
- Where does the meaning actually originate in reader-detected resonance across language?
- Can pragmatic competence emerge from text exposure without interactive grounding?
- Can LLMs infer situational context the way humans do pragmatically?
- Can language models reason without relying on learned semantic patterns?
- How does implicit meaning processing limit LLM pragmatic reasoning?
- Why do language models fail at implicit discourse relations while handling explicit connectives?
- Why do explicit discourse connectives help LLMs but implicit relations cause failures?
- Can LLMs predict social norms without deep integration into linguistic practices?
- Do metaphors work by decoupling meaning from linguistic associations?
- Why do explicit discourse connectives work when implicit relations fail?
- Does DPO training with coreference chains teach spontaneous convention formation?
- Why do explicit linguistic markers override semantic computation in models?
- How does bidirectional entailment distinguish semantic equivalence from token similarity?
- Can language models learn internal world models without explicit environment specifications?
- Do LLMs learn abstract grammar or culturally situated discourse patterns instead?
- Can a formal proximity argument rule out consciousness in systems like large language models?
- Why does training data saliency distort how models judge meaning?
- How do humans learn language through communication differently than LLM text prediction?
- Can statistical learning from language alone capture all aspects of cultural competence?
- Do language models learn surface patterns instead of underlying linguistic principles?
- Can implicit linguistic information ever be reliably learned from training data?
- Can large language models understand language without embodied grounding systems?
- Does next-token prediction alone produce genuine functional language competence?
- Can language models acquire meaning from distributional patterns alone without joint attention?
- Does embodiment and interaction matter for linguistic competence beyond pattern learning?
- What distinguishes surface cues from structural meaning in language understanding?
- Do language models actually learn linguistic structure or just surface statistics?
- Do language models encode deep syntactic structure or only surface-level patterns?
- What distinguishes surface generalizations from true linguistic generalizations?
- Why do surface generalizations fail on unusual syntactic structures?
- Do LLMs learn linguistic generalizations or just surface-level frequency patterns?
- Can formal language pretraining address surface generalization without learning true linguistic structure?
- Do LLMs learn surface patterns instead of genuine linguistic structure?
- How do language models transmit traits through semantically unrelated data?
- What distinguishes real understanding from superficial pattern matching?
- Can statistical learning from text replace embodied cultural experience?
- Are static embeddings analogous to the formal linguistic competence layer?
- How do pretrained language models represent inferential patterns versus lexical and positional cues?
- Can language acquisition analogies mislead us about how models actually learn?
- How do low-dimensional representation structures entangle multiple cultures together?
- Can mechanistic interpretability reveal how ideologies decompose into simpler features?
- How does mechanistic interpretability reveal ideological structures in language model weights?
- How do semantic features in representations become steerable task-specific directions?
- How do world models decompose between representation of facts versus generative mechanisms?
- What makes a new representational primitive valuable enough to justify its representational cost?
- Does functional grounding through discourse patterns count as genuine semantic meaning?
- How does semantic grounding differ between human minds and language models?
- How does the symbol grounding problem apply to artificial language systems?
- How do world models create indirect causal grounding without physical environment contact?
- Can language models develop world models that ground meaning in causal reality?
- Can functional semantic grounding substitute for true causal grounding?
- How does Wittgenstein's language games explain social grounding in LLMs?
- What makes internal embeddings useful as multimodal input for language model training?
- Do speech encoders actually learn the physics of how vocal tracts produce sound?
- How do speech encoders learn articulatory physics without phonetic labels?
- Can speech encoders learn vocal tract physics without phonetic labels?
- Why do users attribute consciousness to language models in practice?
- What architectural changes would let language models develop genuine functional competence?
- What structural properties of language models make fabrication inevitable?
- Can encoder models match human conceptual structure better than larger language models?
- Why do language models need external temporal signals at all?
- How does syntactic encoding relate to semantic feature representation?
- Can LLMs improve at metaphor if they handle decoupled semantics better?
- How do internal representations compare to human cognitive structures?
- Can LLM semantic representations exist without causally influencing their generation output?
- Can LLMs reason through semantics without understanding causal mechanisms?
- What makes human language fundamentally different from what language models produce?
- Do language models need words to think or just latent structure?
- How do different LLMs converge on similar argumentative structures independently?
- How do LLMs build concepts without embodied experience or mental models?
- Can LLMs infer implicit meaning without surface linguistic markers?
- Can LLMs develop genuine understanding without embodied experience?
- Why does LLM compression eliminate causal grounding in conceptual representations?
- Can external actions provide causal necessity that language models lack?
- Do distributed relational tasks consistently underperform local classification across NLP domains?
- What are the scaling law differences between vision and language learning?
- How does co-occurrence statistics alone produce hierarchical concept organization?
- How does scaling and training data enable compositional behavior without symbolic mechanisms?
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Computational structuralism: Toward a formal theory of meaning in the age of digital intelligence
- Mechanistic Indicators of Understanding in Large Language Models
- From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning
- Semantic Structure in Large Language Model Embeddings
- What Do Large Language Models Know? Tacit Knowledge as a Potential Causal-Explanatory Structure
- CoT is Not True Reasoning, It Is Just a Tight Constraint to Imitate: A Theory Perspective
- The Homogenizing Effect of Large Language Models on Human Expression and Thought
- Probing Structured Semantics Understanding and Generation of Language Models via Question Answering
Original note title
LLMs operationalize Saussures langue — fully relational models with no external referents suffice to generate contextually appropriate discourse