When an AI support bot hands you off to a human, what should it actually tell them about you first?
What context should transfer automatically when escalating from AI to human support?
This explores what information an AI support agent should pass to a human when it hands off a case, and what the corpus suggests about which kinds of context get lost in the handoff and which matter most.
This explores what an AI support agent should pass along when it hands a customer to a human, and which kinds of context tend to get lost on the way. The collection has no paper that studies handoff packets directly. Several findings from neighboring areas still point to a clear answer: the obvious package (transcript, issue category, account details) leaves out what most often decides whether the human can actually help.
The strongest evidence comes from a randomized field experiment on Alibaba's Taobao. When human workers took over after the AI failed, service quality recovered for technical problems the AI couldn't handle, but not for customers who were already frustrated. Timing mattered too: early handoffs worked, and late ones that came after frustration had built up did not When human workers take over from AI, does it actually fix the problem?. So the most important thing to transfer may not be what the problem is. It may be how the customer feels, how long they've been stuck, and how many failed attempts they've already sat through. A transcript technically contains all of this, but a human skimming it under time pressure won't see it unless it's flagged.
A second candidate is what the AI *doesn't* know. One study found that language models have no explicit record of what remains unknown about a user, which feeds sycophancy and made-up answers. Adding a list of labeled unknowns to the prompt cut harmful advice and hallucination roughly in half Do language models know what they don't know about users?. Applied to escalation, a good handoff would include a list of open questions: what the AI assumed, what it never confirmed, and where it guessed. A related finding about workplace AI shows why this has to be deliberate. When work passes through AI, signals of effort and uncertainty tend to vanish from the finished output, while polished, identity-bearing signals survive Which workplace cues survive AI mediation and which disappear?. A neat AI summary can look more certain than the conversation behind it actually was.
The handoff should also be designed rather than dumped, because AI context is built fresh for each request from shifting sources, unlike the stable state of conventional software How does AI context differ from conventional software context?. Which pieces reach the next party is a product decision, not something the model does on its own How do AI products decide what to remember between conversations?. Some of what shaped the AI's behavior is also invisible to the customer, such as system-prompt rules and policies Who actually controls what AI systems say?. A human agent who doesn't know the bot was told to refuse refunds can't explain to the customer why it refused. Research on delegation between agents adds one more point: passing along a short, evidence-grounded summary works better than passing everything Can delegation teach models to manage context more actively?.
Finally, escalation might be better treated as an ongoing partnership than a single hand-over. Work on human-agent systems argues that nobody knows the ideal moment to hand off, so good designs spread the decision across several touchpoints, such as co-planning, action guards, and verification When should human-agent systems ask for human help?. Others describe AI systems that assign tasks *to* humans, which raises the question of who is responsible for the case after the switch Can AI systems delegate tasks back to humans?. Taken together, the corpus suggests a handoff should carry four things: the customer's emotional state and history of failed attempts, an explicit list of unknowns, the hidden rules that shaped the AI's answers, and a clear statement of who now owns the case. The Taobao result adds that no handoff package can make up for escalating too late.
Sources 9 notes
A randomized field experiment on Alibaba's Taobao found that when workers took over after AI failures, service quality recovered for capability mismatches but not for customer frustration. Timing mattered: early intervention succeeded; late escalations after frustration accumulated failed to recover quality.
Research shows assistants suffer from sycophancy and hallucination because they have no representation of what remains unknown about users. Adding a schema of labeled unknowns to prompts reduced harmful advice and sycophancy by 50–75% and cut hallucination rates by roughly half.
Analysis of 1,250 interviews found workers preserve identity-bearing cues like voice and provenance but allow effort, attention, and uncertainty to vanish into deliverables. This asymmetry occurs because output-centered work treats finished tasks as proof work happened, leaving labor-bearing cues unexamined.
AI interactions operate on a substrate of constantly shifting context—prompt, history, retrieved data, hidden state—that users cannot internalize like traditional UIs. This structural mutability demands a new design discipline centered on context engineering rather than interface design.
Nielsen Norman Group's glossary shows that context is dynamically assembled from multiple sources—including stored memory—for each request. Because products control which memories get surfaced, claims about what an AI remembers describe the product, not the underlying model.
Show all 9 sources
System prompts operate as a confidential three-tier control structure where developers set foundational rules users cannot see or influence. Evidence from 2025 incidents shows small prompt edits can abruptly shift model behavior, yet users remain excluded from this layer.
SearchSwarm shows that training models to delegate subtasks and integrate summarized results beats passive compression, with a 30B model matching much larger ones. Critically, the delegation skill transfers to single-agent tasks, suggesting it teaches disciplined decomposition and evidence grounding, not just orchestration.
Magentic-UI identifies co-planning, co-tasking, action guards, verification, memory, and multitasking as mechanisms that work around the lack of ground truth for optimal deferral timing. Rather than solving the timing problem directly, these mechanisms distribute decision-making across multiple touchpoints.
Holldack, Banh and Strobel argue that agentic information systems capable of independent decision-making can transfer rights and responsibilities to humans, reversing the traditional one-directional delegation model. This requires moving beyond agency-primacy frameworks to delegation theory that accounts for bidirectional task assignment.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Agentic AI and Human-in-the-Loop Interventions: Field Experimental Evidence from Alibaba's Customer Service Operations
- Intelligent AI Delegation
- The Designer's AI Glossary: Familiar Words, New Meanings
- HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Workslop: Examining the prevalence, antecedents and consequences of low-quality AI-generated content at work
- The Fabricated Front: Generative AI and the Opacity of Workplace Performance
- Agentic information systems