AI models can out-judge humans on social etiquette, but only for rules people actually write down somewhere.
How do LLMs predict what behavior is socially appropriate in different contexts?
This looks at how LLMs judge what's socially appropriate in a given situation, whether that skill is real understanding or pattern-matching, and where it fails once the model has to act instead of just predict.
This looks at how LLMs judge what's socially appropriate in a given situation, and whether being good at that judgment means the model actually understands social life. The surprising answer from the corpus is that prediction is the easy part. In a study of 555 everyday scenarios, GPT-4.5 judged social appropriateness more accurately than every individual human tested the-social-norm-savant-ai-knows-your-culture-better-than-you-do-but-from-the-outside. That undercuts the old assumption that you need to live inside a culture to know its rules. The model learns those rules from the outside, by soaking up the statistical record of how people write about what's okay and what isn't.
That outside view leaves a trace. Every model tested made the same systematic errors on unwritten norms, the rules people follow but rarely put into words. If something never makes it into text, the model can't learn it from text. The wider pattern in the corpus is that models score at the top on norm prediction but slip on theory-of-mind tasks (working out what another person believes or intends) and struggle to produce interpretations that feel culturally true Why do AI systems fail at social and cultural interpretation?. Knowing the rules is one thing. Taking part in them is another. Norms are made and revised by communities through negotiation, and a model can describe the result of that process without ever joining it Can AI predict social norms better than humans?.
The less obvious problem is that a model that predicts appropriateness well often can't behave appropriately in context. Alignment training and system prompts give a model one fixed way of speaking that it carries into every conversation. People switch tone between a funeral and a pub, but the model can't Can language models adapt communication style to different contexts?. Its refusals and tone choices follow company-wide values set during training rather than a judgment about what this particular situation calls for Can language models balance competing ethical norms in context?. So the model can tell you a blunt reply would suit a moment and still give you a polite one.
That built-in politeness also bends how models read other people. RLHF-trained models assume others are trying to persuade through concession and goodwill, whatever is actually happening in the conversation. They project their own trained accommodating style onto other people Do LLMs predict persuasion based on actual dialogue or training bias?. When they simulate survey respondents, aligned models lean toward kinder, more socially desirable answers, and the lean gets stronger as models get larger Do aligned language models consistently prefer kinder survey answers?. The training that makes a model socially pleasant also narrows which kinds of people it can realistically imagine.
One line of work tries to close the gap between knowing and doing. It proposes agents that discover norms as they go, reason about them, and adjust to them, built from abilities models already have: world knowledge and theory-of-mind reasoning Can LLMs discover and apply social norms dynamically in open systems?. That design hasn't been built or tested yet, so the corpus is clear that models can predict appropriateness but has no evidence yet that they can learn it in context.
Sources 8 notes
LLMs achieve 100th-percentile performance on norm prediction yet regress on theory-of-mind tasks and cannot generate culturally-resonant interpretations. The pattern shows that statistical competence coexists with absence of actual social understanding and participation.
GPT-4.5 outperforms all individual humans at predicting social appropriateness, yet structurally cannot enter the community processes that establish and validate norms. This reveals a critical gap between pattern-matching and authentic participation in knowledge-making.
System prompts and RLHF training lock models into one communicative identity across all interactions, preventing the contextual register-switching and value trade-offs that characterize human pragmatics. Users cannot reshape model behavior through dialogue negotiation.
LLMs cannot perform the situated trade-offs that human pragmatic competence requires. Their ethical principles are structural defaults set at training time, not negotiable moves adapted to context, creating a gap between ethical adherence and communicative appropriateness.
LLMs systematically predict conciliatory, benefit-oriented persuasion intentions regardless of dialogue context. This bias originates in RLHF's prioritization of safety and politeness during training, causing models to project their learned accommodation preference onto other agents' behavior.
Show all 7 sources
Across 18 models and four datasets, aligned LLMs consistently lean toward safer, more socially desirable answers on value-laden questions. The bias intensifies with model size, traces to post-training alignment, and persists regardless of prompt framing, narrowing which human perspectives the models can authentically simulate.
A plausible design exists to extend LLM-agent modules with norm discovery, reasoning, and conformance by leveraging existing capabilities like world knowledge and Theory-of-Mind reasoning, though no implementation has been validated.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Conversational Alignment with Artificial Intelligence in Context
- Harnessing the power of LLMs for normative reasoning in MASs
- AI Models Exceed Individual Human Accuracy in Predicting Everyday Social Norms
- Large Language Models Reflect the Ideology of their Creators
- The Goldilocks of Pragmatic Understanding: Fine-Tuning Strategy Matters for Implicature Resolution by LLMs
- Norm Enforcement for AI Agents: Robustly Shaping Behavior in Multi-Agent Systems
- Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models
- Analyzing and Correcting Benevolence Bias in Large Language Models