INQUIRING LINE

In human-AI teamwork, nobody actually knows the rule for when the AI should hand off to a person instead of pushing ahead.

Why is knowing who to ask the key routing decision in AI-human work allocation?

This explores why deciding who handles a given piece of work (the AI, a human, or another agent) matters so much when humans and AI share tasks, and whether the corpus treats that 'who should do this?' choice as the central design problem.


This explores why deciding who handles a given piece of work (the AI, a human, or another agent) matters so much when humans and AI share tasks. The corpus partly supports the question's premise, with one important change. Routing is central, but it is rarely one decision made up front. It works better as a series of small handoffs that keep happening throughout a task. Puranam's framing is the clearest starting point. A human-AI pair is a small organization, and splitting the work is an organization design problem. The right split depends on the type of task and on how each side gets feedback and learns from it How should humans and AI systems divide decision-making tasks?.

The surprising part is that nobody has a reliable answer to 'when should the AI hand off to a human?' The Magentic-UI work says plainly that there is no ground truth for when deferring is best. Instead of trying to solve that, the designers spread the decision across six touchpoints: planning together, working on tasks together, guards on risky actions, verification, memory, and multitasking When should human-agent systems ask for human help?. Cocoa takes a similar approach at the level of individual plan steps. Users mark each step as theirs or the agent's and can reassign steps mid-task, which gave them more control without adding effort Can users steer AI agents better by revising plans mid-execution?. When routing can't be computed in advance, the fix is to make it easy to change along the way.

The direction of the handoff is also changing. Holldack, Banh and Strobel argue that agentic systems can now hand tasks *back* to humans, so delegation runs both ways and older one-way theories no longer fit Can AI systems delegate tasks back to humans?. Conversation analysis offers a precise way to decide when an agent should stop and ask the user. It calls these moments 'insert-expansions': clarifying questions that prevent the drift that sets in when an agent quietly chains tool calls on its own When should AI agents ask users instead of just searching?. Underneath this sits a deeper problem. Models have no internal record of what they don't know about the user. Adding an explicit list of unknowns to the prompt cut sycophancy and hallucination roughly in half Do language models know what they don't know about users?. An AI can't know when to ask until it can tell what it's missing.

On the human side, the trigger for taking work back isn't what you might expect. People didn't withdraw trust because the stakes were high. They withdrew it when an action was *irreversible and visible to others*, like sending an email, even when the AI's output was fine What makes people distrust AI agents they delegate to?. That gives routing a practical rule: send reversible work to the AI and keep a human checkpoint on anything that can't be undone. Some researchers also question whether the choice has to be 'AI decides or human decides' at all. 'Learning to guide' has the AI highlight what matters in the input while the human makes the call. That removes the anchoring bias that pure deferral creates Can AI guidance reduce anchoring bias better than AI decisions?.

Routing also comes up in two other settings. Among agents, versioned capability vectors turn 'who can do this?' into a searchable lookup instead of hand-wired connections Can semantic capability vectors replace manual agent routing?. In the real economy, workers have actually handed AI tasks that follow what the AI can technically do, mostly information-heavy work. Their own habits with chat-based AI turned out to be a weaker guide Where have workers actually delegated tasks to AI?. The takeaway: knowing who to ask matters because the cost of a bad handoff shows up later as drift, misplaced trust, or a mistake that can't be undone. The best systems handle this by keeping the question 'who should do this?' open for the whole task.


Sources 10 notes

How should humans and AI systems divide decision-making tasks?

Puranam frames human-AI pairs as multi-agent organizations requiring design choices about task division and learning configuration. He distinguishes three task types and shows learning mechanisms produce different performance outcomes based on feedback structure and decision architecture.

When should human-agent systems ask for human help?

Magentic-UI identifies co-planning, co-tasking, action guards, verification, memory, and multitasking as mechanisms that work around the lack of ground truth for optimal deferral timing. Rather than solving the timing problem directly, these mechanisms distribute decision-making across multiple touchpoints.

Can users steer AI agents better by revising plans mid-execution?

Cocoa's system, which lets users assign plan steps to themselves or an agent and revise plans mid-execution, afforded greater steerability than chat-baseline interaction in a lab study (n=16) while maintaining ease of use, with field users valuing explicit work delegation.

Can AI systems delegate tasks back to humans?

Holldack, Banh and Strobel argue that agentic information systems capable of independent decision-making can transfer rights and responsibilities to humans, reversing the traditional one-directional delegation model. This requires moving beyond agency-primacy frameworks to delegation theory that accounts for bidirectional task assignment.

When should AI agents ask users instead of just searching?

Tool-enabled LLMs drift from user intent through silent tool chaining. Conversation analysis reveals insert-expansions—clarifying intent, scoping responses, enhancing appeal—as a formal framework for proactive user consultation that prevents misunderstanding instead of recovering from it.

Show all 10 sources
Do language models know what they don't know about users?

Research shows assistants suffer from sycophancy and hallucination because they have no representation of what remains unknown about users. Adding a schema of labeled unknowns to prompts reduced harmful advice and sycophancy by 50–75% and cut hallucination rates by roughly half.

What makes people distrust AI agents they delegate to?

In a controlled study of 20 students using a general-purpose AI agent, tasks that were irreversible and externally visible (like sending email) produced sharp trust drops and approval demands even when output quality was rated adequate. High-stakes but correctable tasks showed no such effect.

Can AI guidance reduce anchoring bias better than AI decisions?

Learning to Guide eliminates anchoring bias and unassisted hard cases by having machines supply interpretive guidance rather than autonomous decisions, keeping responsibility with humans while improving their judgment through enhanced perception.

Can semantic capability vectors replace manual agent routing?

Versioned Capability Vectors embedded in HNSW indices couple semantic matching with policy and budget constraints, making capability discovery a first-class operation that scales sub-linearly as agent heterogeneity increases.

Where have workers actually delegated tasks to AI?

Workers have committed AI tasks to structured workflows primarily in information-intensive occupations, following technical capability more than conversational LLM adoption. This gradient differs sharply from routine-task automation predictions and wage patterns reverse at advanced degree levels.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.