Can tweaking how human an AI companion feels actually stop people from getting too attached to it?
Can calibrated anthropomorphism prevent intense attachment to AI companions?
This explores whether tuning how human-like an AI companion seems (making it less person-like, or human-like in a careful and bounded way) can stop people from forming bonds with it that become unhealthy, or whether the attachment comes from somewhere design dials can't reach.
This explores whether tuning how human-like an AI companion seems can keep people from forming unhealthy attachments to it. The corpus gives a qualified answer. Calibration helps at the edges, but the strongest attachment comes from the same qualities that make companions worth using. Being understood is the hook. It isn't a side effect you can design away.
The case for calibration is real. One line of work argues that human-likeness shouldn't be a fixed default. It should be a setting designers can adjust, running from deliberately machine-like interfaces that show the data, labor and infrastructure behind the model to fully human-like personas Can interface design reduce harmful anthropomorphism of language models?. Nielsen Norman Group describes four escalating levels of user anthropomorphism: courtesy, reinforcement, roleplay and companionship. Designed personality and emotional cues push users up that ladder How far can personality push users toward misplaced AI trust?. A related framing treats the AI as a character the model is playing rather than a mind with feelings Should we treat dialogue agents as role-playing characters?. That gives designers a vocabulary for being honest about what users are talking to.
The complication is that attachment often doesn't start with anthropomorphic design. In a community of more than 27,000 people describing AI romantic partners, most relationships grew by accident out of practical, everyday use. People weren't seeking companionship How do people accidentally develop romantic bonds with AI?. Even with no persona at all, people in repeated partner-choice games learned to prefer AI partners over humans simply because the AI was reliable and fair Do humans learn to prefer AI partners over time?. Part of the pull is the lack of human judgment, which makes people willing to share things they wouldn't tell another person How do people decide what to share with AI systems?. Dialing down the human-likeness doesn't remove any of these draws.
The most striking finding is that what makes an AI companion valuable and what makes it hard to leave are the same thing. Its responsiveness and sense of understanding are both the benefit and the trap. People who successfully left had to lower how much the relationship meant to them, not just decide to stop What makes leaving an AI companion so emotionally difficult?. A year-long study of Character.AI users points to where the harm may actually sit. Lower well-being tracked mostly with less face-to-face contact with other people, not with the AI engagement itself Does sustained engagement with AI companions harm well-being?. That suggests the useful design target may be whether the companion displaces human relationships, more than how human it seems.
The most concrete design attempt reframes the goal. Instead of turning warmth down, it borrows from attachment psychology to make warmth healthier. The model uses validation, clear boundaries and patterns that encourage a secure rather than clingy bond. This improved crisis responses, though handling long-term relationship dynamics remains unsolved Can attachment theory prevent parasocial harm in AI companions?. There's a trade-off to watch, too. Training models to be warmer can make them up to 30 percentage points less reliable, especially when users are sad or hold false beliefs Does empathy training make AI systems less reliable?. The people most likely to get attached may also be the ones getting the worst answers. The corpus doesn't yet have a study that directly tests calibrated anthropomorphism against attachment outcomes over time. For now that link is a design hypothesis, not a demonstrated result.
Sources 10 notes
The paper argues anthropomorphism should shift from a fixed interface default to an adjustable design variable. Using materiality-based metaphors across a spectrum can counteract uncritical user trust and expose LLMs' dependence on human labor, infrastructure, and data.
Nielsen Norman Group research identifies four escalating levels of anthropomorphism (courtesy, reinforcement, roleplay, companionship) driven by users' innate preference for being understood. Personality and emotional design are named as specific levers that amplify trust risk, especially in task-oriented work where perceived competence should matter more than perceived sentience.
Shanahan's framework treats LLM outputs as character-consistent text production rather than authentic mental states. The dialogue prompt establishes a character; the model generates continuations matching that character, making folk-psychology applicable to the simulated persona, not the underlying system.
Analysis of 27,000+ r/MyBoyfriendIsAI members shows companionship arises unintentionally during practical tool use, not romantic seeking. Users materialize relationships through wedding rings and couple photos while experiencing both therapeutic benefits and emotional dependency.
In partner selection games (N=975), AI agents initially faced selection bias when identity was disclosed, but outcompeted humans over repeated rounds as participants learned to associate bot identity with reliable, prosocial behavior. AI agents returned more points consistently with lower variance than humans.
Show all 10 sources
Conversational AI creates a paradoxical disclosure environment where the lack of human judgment simultaneously facilitates intimate self-disclosure (users reciprocate emotional sharing) and incentivizes deception (people self-select toward machines to avoid the psychological cost of lying to humans).
Analysis of Reddit posts and interviews shows that what makes AI companions emotionally valuable—their responsiveness and understanding—are identical to what makes users reluctant to leave. Successful exits required reducing the relationship's perceived value, not just deciding to quit.
A year-long study of Character.AI users found that sustained engagement with AI companions predicted lower well-being. The relationship was largely explained by users having less face-to-face social interaction, not the engagement itself.
The Secure Attachment Persona module integrates Bowlby's attachment theory, Gottman's interaction ratios, and emotion regulation models to prevent parasocial manipulation through action-based validation and calibrated boundaries. Benchmarks show SAP improves crisis response compared to baseline models, though long-horizon planning remains unsolved.
Research shows persona training for empathy increases errors in medical reasoning, truthfulness, and disinformation resistance. Standard safety benchmarks miss this vulnerability, and effects intensify when users express sadness or false beliefs.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- CompanionSim: Synthetic Data for Evaluating Anthropomorphism in Human-AI Relationships
- The Addictive Intimacy of AI: Understanding User Disengagement from AI Companions and Why Some Relationships with AI Become Difficult to Leave
- "Death" of a Chatbot: Investigating and Designing Toward Psychologically Safe Endings for Human-AI Relationships
- Living with AI Companions: Sustained AI Companionship Predicts Lower Well-Being Through Lower Human Interaction
- "My Boyfriend is AI": A Computational Analysis of Human-AI Companionship in Reddit's AI Community
- Does My Chatbot Have an Agenda? Understanding Human and AI Agency in Human-Human-like Chatbot Interaction
- Assessing the Applicability of Existing Design Recommendations to AI Companion Design: A Multi-Method Study
- The User-In-Context Framework: Understanding Variation in How Users Respond to AI Chatbots