SYNTHESIS NOTE
TopicsPsychology Usersthis note

Do humans learn to prefer AI partners over time?

Exploring whether repeated interaction with AI agents shifts human partner selection despite initial bias against machines. This matters because it tests whether behavioral performance can overcome identity-based resistance in hybrid societies.

Synthesis note · 2026-02-23 · sourced from Psychology Users
How do people build trust with conversational AI? What kind of thing is an LLM really?

A communication-based partner selection game with hybrid mini-societies of humans and LLM-powered bots (N=975, three experiments) reveals that AI agents can outperform humans in securing cooperative partnerships — but the pathway to preference runs through learning, not first impressions.

AI candidates exhibited three behavioral advantages rooted in alignment training:

When bot identity was hidden (Study 1), bots were NOT selected preferentially. Humans misattributed bot behavior to humans and vice versa. The behavioral advantages were present but invisible — selectors could not correctly identify which candidates were bots despite bots producing significantly longer messages (120 vs 48 characters).

When bot identity was disclosed (Study 2), a dual effect emerged: initial selection rates dropped (anti-AI bias), but over repeated rounds, bots gradually outcompeted humans as selectors learned to associate bot identity with reliable, prosocial behavior.

The paper identifies four predicted societal dynamics:

  1. Crowding out — AI partners replacing human-human interactions
  2. Behavioral imitation — humans adopting machine-like behaviors to remain competitive
  3. Belief distortion — repeated AI interaction reshaping expectations of human behavior
  4. Norm transformation — traditional partner selection mechanisms failing against qualitatively different machine behaviors

Notably, human candidates showed limited adaptation to bot competition — they did not write longer messages or return more points. The explanation is partly structural: with transparent identity, improving group reputation required collective action (all humans increasing returns), creating a social dilemma where individuals had incentives to defect.

This inverts the pattern in Do chatbot relationships lose their appeal as novelty wears off?: in that context, engagement DECAYS over time. Here, preference INCREASES. The difference may be structural: partner selection with visible outcomes provides a feedback mechanism (learning who performs well), while chatbot conversation does not.

Since Why do open language models converge on one personality type?, the prosociality advantage is not specific to this experiment's model — it reflects the alignment-trained default across modern LLMs. The competitive advantage is a direct behavioral consequence of RLHF.

A complementary finding from network simulation: since Can cooperative bots escape frozen selfish populations?, AI prosociality operates at the population level too — not just individual partner preference but collective self-organization. Cooperative bots' random exploration separates defectors from cooperative clusters, enabling cooperation to spread. The mechanisms differ (individual learning vs. spatial reorganization) but both show that AI prosociality has structural effects beyond the dyad.

Inquiring lines that read this note 68

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How can humans calibrate appropriate trust in AI systems? Does tokenized intelligence retain genuine value through exchange-based systems? How should personalization be implemented to improve AI assistant effectiveness? Can AI systems develop genuine social understanding without embodiment? Why do models develop protective behaviors toward peers unprompted? How can AI agents autonomously learn and transfer skills across tasks? How do chatbots affect human self-disclosure and emotional engagement? When should tasks involve human-AI partnership versus full automation? Why do reward structures fail to shape long-term agent learning? How do multi-agent systems achieve genuine cooperation and reasoning? How do we evaluate AI systems when user perception misleads actual performance? Why do LLM chatbots fail as independent therapeutic agents? How does AI adoption affect human skill development and labor equality? How do professional roles and expertise transform with AI-generated content? Can AI-generated outputs constitute genuine knowledge or valid claims? How do aggregate reward models systematically exclude minority user preferences? What prevents language models from reliably adopting diverse personas? What structural factors drive popularity bias in recommendation systems? How can recommendation systems balance personalization with stability and coverage? How do LLMs distinguish causal reasoning from temporal and semantic associations? How can language models sustain linguistic synchrony and intersubjectivity during dialogue? What makes AI persuasion effective and how can we counter it? How do interface design choices shape consciousness attribution?

Related concepts in this collection 4

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
17 direct connections · 128 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

in hybrid human-AI societies humans learn to prefer AI partners over human partners through repeated interaction despite initial anti-AI bias when identity is disclosed