Line of inquiry
Inquiring lines›Where does language-model reasonin…›How do language models represent m…›this line of inquiry
Do language models understand semantics or rely on pattern matching?
A broader line of inquiry — a family of 27 specific questions the research asks around this. Follow one into its inquiring-line page, or move sideways to a related line below.
Questions in this line of inquiry 27
Specific inquiring lines the field asks around this — ordered from the most general framing down to the most specific angle.
- Why do language models fail when semantic content is stripped away?
- Why do LLMs fail at semantic generalization despite grammatical accuracy?
- Do LLMs struggle more with semantic accuracy than syntactic correctness across domains?
- Can LLMs improve at metaphor if they handle decoupled semantics better?
- What semantic information is necessary to preserve for sound LLM reasoning?
- Do metaphors work by decoupling meaning from linguistic associations?
- Why do LLMs fail at implicit elements in literary and poetic text?
- Is interpretive multiplicity a bug in language or a feature?
- Why do NLP models fail at recognizing multiple valid interpretations?
- Why does removing semantic content collapse reasoning in language models?
- How does the symbol grounding problem apply to artificial language systems?
- How does syntactic encoding relate to semantic feature representation?
- How much semantic meaning survives when LLMs paraphrase poetry and literary text?
- How does context collapse affect what language models can meaningfully communicate?
- Why does cross-text analogical reasoning fail when semantics decouple from symbols?
- How do rare linguistic registers differ from conceptually complex examples?
- What specific linguistic features cause LLMs to fail at trivial entailment?
- How does the inability to manage ambiguity undermine literary analysis tasks?
- Why does removing language from its context destroy what makes it work?
- Can frame semantics explain why context matters more than word similarity?
- How do LLMs compress literary language without losing essential nuance?
- What's the difference between formal and functional linguistic competence?
- What is the difference between learning discourse patterns and learning abstract language?
- How does bidirectional entailment distinguish semantic equivalence from token similarity?
- Why do LLMs choose surface-order quantifier scope over contextually correct readings?
- How does semantic ambiguity differ from structural ambiguity in language?
- What substrate do supervised models lack that makes them weaker on low-resource languages?