Companies say they want control over their AI agents — but does that word mean what they think it means once the agent is actually running?
How do business users rank control against other workplace AI design priorities?
This explores where 'keeping humans in control' sits among the things business users say they need from workplace AI agents, and whether control actually works the way that ranking implies.
This explores where human control ranks among the design priorities business users name for workplace AI agents, and what 'control' means once those agents are deployed. The most direct evidence comes from a multi-method study that found eight UX principles for workplace agents. Business users put four of them at the top: human control, reliability, context-awareness, and safety What UX principles do workplace users want in AI agents?. The corpus doesn't order these four against each other. They work as a group of minimum requirements for adoption. Without them, users don't accept the agent and don't collaborate with it. So control isn't traded off against the others. It sits alongside reliability and safety as part of what people need before they will use the tool at all.
The more interesting finding is that what users say they want and what they actually get can be quite different. A study of junior and senior engineers found that company rules (tool mandates, allow-lists, data policies) decide how much control a person keeps over agentic AI before personal preference comes into it Does personal preference shape how engineers use AI tools?. The same pattern shows up at the organizational level. BCG's survey of nearly 12,000 employees found that clear strategic direction predicted value better than access to tools Does strategic direction matter more than AI tool access?. In practice, control is often set by the organization's design choices, not by the individual user.
Holding formal control is also different from feeling in control. Leonardi shows that when people credit an AI with independent judgment, their sense of control and responsibility shrinks, even though they keep full formal authority Does attributing agency to AI actually reduce human sense of control?. The good news in that work is that the loss is reversible: people take control back in later phases of the cycle. Other work goes further and argues that agentic systems can reverse delegation by handing tasks to humans Can AI systems delegate tasks back to humans?. That raises the question of who is controlling whom. It also helps explain why 'context-awareness' sits next to control on users' list. AI context (prompts, history, retrieved data) keeps shifting in ways users can't track the way they would track a normal interface How does AI context differ from conventional software context?, so steering the agent depends on understanding what it is working from.
Control also doesn't mean users want to do everything themselves. A survey of 1,500 workers across 844 tasks found that equal human-AI partnership is the most-wanted level in 45% of occupations, and that 41% of startup investment targets areas that don't match what workers want What collaboration level do workers actually want with AI?. Read this way, 'control' is mostly about having a clear say in how work is divided, not about holding a veto. That fits with framing human-AI decision-making as an organization design problem How should humans and AI systems divide decision-making tasks? and with Human Factors proposals for clear task allocation and continuous feedback, though those proposals haven't been tested yet Can Human Factors design fixes restore GenAI productivity losses?.
One note on what the corpus can't tell you: none of these sources ranks control above or below reliability or safety. The sharper takeaway is that the control users ask for is often already decided by company policy, and it can slip away psychologically even when nobody takes it away formally.
Sources 9 notes
A multi-method study identified eight UX principles for workplace AI agents, with business users weighting human control, reliability, context-awareness, and safety as practical necessities for user acceptance and effective collaboration.
A study of 10 junior and 10 senior engineers found organizational rules—tool mandates, allow-lists, and data policies—preconfigure how much control engineers retain over agentic AI, overriding personal preference. Novices then struggle between over-reliance and avoidance within these constraints.
BCG's survey of 11,749 employees found that strategic direction predicts sustained value and satisfaction better than tool availability. Companies redesigning workflows end-to-end captured more value than those deploying tools without organizational direction.
Leonardi shows that when humans credit AI with independent judgment, they experience reduced sense of control and responsibility—even while retaining formal authority. This displacement circulates through five phases: delegation, attribution, contingency, reassertion, and reconfiguration, making it strategically manageable rather than permanent.
Holldack, Banh and Strobel argue that agentic information systems capable of independent decision-making can transfer rights and responsibilities to humans, reversing the traditional one-directional delegation model. This requires moving beyond agency-primacy frameworks to delegation theory that accounts for bidirectional task assignment.
Show all 9 sources
AI interactions operate on a substrate of constantly shifting context—prompt, history, retrieved data, hidden state—that users cannot internalize like traditional UIs. This structural mutability demands a new design discipline centered on context engineering rather than interface design.
The HumanAgency Scale survey of 1,500 workers across 844 tasks found that equal partnership (H3) is the dominant desired level in 45% of occupations. Yet 41% of startup investments target zones misaligned with these worker preferences.
Puranam frames human-AI pairs as multi-agent organizations requiring design choices about task division and learning configuration. He distinguishes three task types and shows learning mechanisms produce different performance outcomes based on feedback structure and decision architecture.
Simkute and colleagues map five established automation-design principles onto GenAI interaction challenges, focusing on continuous feedback, personalization, ecological interfaces, task stabilization, and clear task allocation. These proposals remain untested research directions rather than validated interventions.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Guidelines for Human-AI Interaction
- Homo agenticus in the age of agentic AI: Agency loops, power displacement, and the circulation of responsibility
- A Framework of User Experience Principles for Human-AI Agent Interaction in the Workplace
- The Work Behind Delegation: A Framework for Supervising AI Coding Agents
- HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants
- Can AI Do Strategy?
- Putting AI on the Org Chart: Evidence on Delegation and Accountability