How does research on LLMs as social objects organize itself?
Research treating LLMs as social entities has grown rapidly but lacks integration. Does systematic study reveal natural categories for understanding how LLMs behave socially, interact with each other, and affect people?
The paper proposes a taxonomy for a field it calls the "social science of LLMs": systematic research that treats LLMs or LLM-based agents themselves as social objects of explanation. Its abstract says research on LLMs in communication, learning, work, creativity, and decision-making has grown rapidly but "remains fragmented and lacks an integrated framework." The analyses recover three domains. LLM as Social Minds concerns socially interpretable model behavior. LLM Societies concerns collective dynamics among interacting model-based agents. LLM–Human Interactions concerns how people perceive, use, and are affected by LLMs.
The framework is defined by what a study seeks to explain rather than by method or discipline. The discussion names a shared object of explanation, LLMs or LLM-based agents "examined through their behaviour, interactions, and social consequences", and says the three domains "distinguish the principal relation requiring explanation." That is the taxonomy's organizing move: a study belongs to a domain according to whether it explains the model's own socially meaningful capacities, the dynamics among many models, or the relation between models and people. The evidence for the three-way split has several parts. Study 1 embeds titles and abstracts from 198 papers with MPNet sentence embeddings and tries K-means solutions from K=2 to 9 with internal validation and stability analyses. The selected three-cluster solution was stable under resampling and matched both the authors' full-text classifications and LLM-based title-and-abstract classifications. Study 2 scales the same question to 47,719 formally published papers from five bibliographic databases.
Read against the library, the neighbors already sit in different domains. Do language models learn abstract grammar or cultural speech patterns? and Can AI systems learn social norms without embodied experience? are Social Minds claims about socially interpretable behavior. Can communication pressure drive agents to learn shared abstractions? is a Societies claim about interacting agents. Why do people trust AI outputs they shouldn't? is an LLM–Human Interactions claim about how people are affected. This paper adds a map of where such claims belong and how they differ in what they explain. That placement is my reading of the notes, not something the paper does with them. Can structural causal models automate social science with language models? straddles the map, using LLM agents as subjects while also being about method.
The excerpt is silent on several things. It gives no cluster sizes, no agreement statistics between the authors' and the LLM classifications, and no account of how the 47,719-paper corpus mapped onto the three domains. The discussion is cut off before it finishes describing the Social Minds domain or saying what mechanisms the proposed research agenda would connect. The stated limitation is that the Study 1 corpus was "purposively curated" and not exhaustive, with Study 2 offered as the check on coverage and breadth. What the excerpt supports is a stable, reproducible three-domain partition of a curated corpus, checked by two classification procedures. It does not show that the partition is the only defensible one, or that these are the domains' final boundaries.
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Do language models learn abstract grammar or cultural speech patterns?
LLMs might learn more than grammar rules—they could be learning who says what to whom and when. This matters because it changes how we understand what biases and persona effects actually represent.
a Social Minds example, treating model behavior as socially situated
-
Can communication pressure drive agents to learn shared abstractions?
Under what conditions do AI agents develop compact, efficient shared languages? This explores whether cooperative task pressure—rather than explicit optimization—naturally drives abstraction formation, mirroring human collaborative communication.
a Societies example, with interacting agents developing shared conventions
-
Why do people trust AI outputs they shouldn't?
When do human cognitive shortcuts fail in AI interaction? Three compounding traps—treating statistical patterns as facts, mistaking fluency for understanding, and avoiding disagreement—may explain systematic overreliance across languages and contexts.
an LLM–Human Interactions example, focused on how users are affected
-
Can structural causal models automate social science with language models?
Can we use structural causal models to let LLMs both propose and test social hypotheses systematically? This explores whether formal causal structure can overcome LLM limitations in social simulation.
a method note that straddles the domains by using LLM agents as social subjects
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Mapping the Emerging Social Science of Large Language Models
- Can Machines Think Like Humans? A Behavioral Evaluation of LLM-Agents in Dictator Games
- The Failure Happens Before the Drift: The Social Dynamics of Values in LLM Agent Societies
- Cultural Evolution of Cooperation among LLM Agents
- Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
- Machine Psychology
- Finding Common Ground: Using Large Language Models to Detect Agreement in Multi-Agent Decision Conferences
- Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs
Original note title
research on LLMs as social objects falls into three domains — LLM as Social Minds, LLM Societies, and LLM–Human Interactions