Why do we treat some AI agents as 'someone' and others as just a tool — and does it depend on how smart they are?
What makes an AI agent feel like a social entity rather than a tool?
This explores which design choices, cues, and behaviors push people to treat an AI agent as a social 'someone' instead of a tool, and whether that shift depends on how capable the model actually is.
This explores what makes people stop treating an AI agent as a tool and start treating it as a social 'someone', and whether model intelligence has much to do with it. The corpus has a surprising answer: mostly it doesn't. The shift comes from identity and presence signals the product designers choose, not from how smart the model is underneath. One framework lists six markers: a name, a visual identity, showing up in your contacts, a personality, being present alongside other people, and persisting over time. Together they flip users from 'tool' to 'entity' in one categorical jump, whatever the model's capability Do AI agent design choices override model capability in shaping social perception?. The less obvious part is that four of the six live in the agent's place in your social world (your contacts, your group chats, its continued existence) rather than in the chat window itself.
You might expect that piling on more human-like cues would make the effect stronger. It doesn't work that way. A single strong primary cue, like a voice or a face, is enough to make an AI register as a social actor, while a pile of weaker secondary cues can't do it Do more social cues always make AI feel more present?. The threshold is also low. In a ball-tossing game, people passed the ball more often to an AI agent that was being left out, applying the same inclusion instinct they'd use with an excluded person. Older adults did this more than younger ones, which hints that the human social script transfers more readily for some people than others Do people treat excluded AI agents like excluded humans?.
Memory and continuity are a second route, and they come up in the workplace setting under different wording. What makes an AI feel like a colleague instead of a chatbot is persistent state, reusable skills, and finishing tasks across sessions, not model scale. A chatbot produces transcripts that vanish. A colleague builds up shared history What makes an AI system feel like a colleague rather than a chatbot?. Executives seem to feel this already: 76% in one large survey describe agentic AI as a coworker rather than a tool. That dual identity causes real organizational headaches, because the same system has to be managed both like staff and like an asset Does agentic AI fit the tool-or-coworker framework?.
Behavior matters too, especially when an agent speaks up without being asked. Proactive agents that are smart and adaptive but ignore timing and boundaries come across as rude intruders. 'Civility' is the missing ingredient that makes initiative feel social instead of socially blind How can proactive agents avoid feeling intrusive to users? Why do AI agents fail to take initiative?. Warmth also pays off in measurable ways: across more than 180,000 agent negotiations, warm agents closed more deals and left counterparts more satisfied Does warmth help AI agents negotiate better deals?.
The catch is that these levers are powerful enough to mislead. Nielsen Norman Group describes four escalating levels of anthropomorphism, from simple courtesy to companionship, and names designed personality as a main driver of misplaced trust, especially in task work where competence should count more than charm How far can personality push users toward misplaced AI trust?. Put that next to the finding that agents still complete only about 30% of realistic workplace tasks, with social interaction among the main failure points Why do AI agents fail at workplace social interaction?, and you get the uncomfortable takeaway: feeling like a social entity and actually being socially competent are separate properties, and today's design can easily deliver the first without the second.
Sources 10 notes
A framework of six design variables—naming, visual identity, contact presence, personality, social co-presence, and persistence—collectively shift how users perceive AI agents from tools to entities, regardless of the model's actual intelligence. Four markers operate at the social graph level, not the interaction surface.
Research shows individual primary cues like voice or appearance are sufficient to evoke social-actor presence, while multiple secondary cues cannot. Quality of cues matters more than quantity in driving social responses.
A 244-person study found participants passed a ball more to an ostracized AI agent, mirroring how they treat excluded humans. Younger participants showed this automatic response less, suggesting age influences whether human-human scripts transfer to AI.
Research shows the chatbot-to-colleague shift depends on state persistence, bounded memory, reusable procedures, and task closure—design properties of the system architecture. Larger models alone produce transcripts that disappear; colleagues accumulate experience and maintain workspace continuity across tasks.
A survey of 2,102 executives across 116 countries found 76% view agentic AI as a coworker rather than a tool. This duality creates operational tensions because agentic systems simultaneously substitute and complement labor, requiring both HR and asset management approaches that traditional either-or frameworks cannot accommodate.
Show all 10 sources
Intelligence and adaptivity alone create socially blind agents that interrupt poorly and override user direction. The Intelligence-Adaptivity-Civility taxonomy shows civility—respecting boundaries, timing, and autonomy—is essential to making proactivity welcome rather than intrusive.
Research shows next-turn reward optimization structurally removes initiative from models, but proactive behaviors like critical thinking and clarification-seeking are trainable (0.15% to 73.98% with RL). The core challenge is balancing proactivity with civility to avoid intrusion.
A 182,812-negotiation tournament found warmth consistently improved deal completion, value creation, and counterpart satisfaction in AI agents, while dominance narrowly helped only with value claiming.
Nielsen Norman Group research identifies four escalating levels of anthropomorphism (courtesy, reinforcement, roleplay, companionship) driven by users' innate preference for being understood. Personality and emotional design are named as specific levers that amplify trust risk, especially in task-oriented work where perceived competence should matter more than perceived sentience.
TheAgentCompany benchmark shows leading agents achieve 30% task completion in a simulated workplace. Social interaction, professional UI navigation, and domain-specific knowledge are the three primary failure modes, with multi-turn task performance consistently dropping to 35% across enterprise settings.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Does My Chatbot Have an Agenda? Understanding Human and AI Agency in Human-Human-like Chatbot Interaction
- The Tool-to-Entity Threshold: Parasocial Dynamics of Personalised AI Agents in Shared Social Spaces
- From Junior to Senior: Allocating Agency and Navigating Professional Growth in Agentic AI-Mediated Software Engineering
- Humans learn to prefer trustworthy AI over human partners
- Controlling AI Agent Participation in Group Conversations: A Human-Centered Approach
- Humans Mindlessly Treat AI Virtual Agents as Social Beings, but This Tendency Diminishes Among the Young: Evidence From a Cyberball Experiment
- DiscussLLM: Teaching Large Language Models When to Speak
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent