If a company's AI agent is both a tool it owns and a coworker it manages, who's actually in charge of it?
What operational tensions emerge from agentic AI's dual nature?
This explores the practical problems that come up when organizations treat agentic AI as both a tool they own and a coworker they manage, and why that split makes it hard to govern, deploy and hold accountable.
This explores the practical problems that come up when agentic AI is both a tool you own and a coworker you manage. The starting point is a striking survey result: 76% of executives already describe agentic AI as a coworker rather than a tool. Yet these systems both replace human labor and add to it. That means companies need HR-style management (roles, oversight, performance) and asset-style management (depreciation, maintenance, ownership) at the same time, and most org charts and budgets are built to do one or the other Does agentic AI fit the tool-or-coworker framework?.
The first tension is about **workflow**. If agents are tools, you'd expect to bolt them onto existing processes. If they're coworkers, you'd redesign the work around them. The evidence favors redesign: many deployments fail because agents get layered onto old workflows instead of whole processes being rebuilt around agent-ready data and coordination Does agentic AI succeed through process redesign or workflow layering?. McKinsey's version goes further, with squads of agents and humans moving 'above the loop' into strategic oversight. But it admits that governance hasn't caught up with that ambition, and that risks come from how agents interact with each other, not just from whether each one is reliable on its own Can AI agents truly operate above the loop at enterprise scale?. The 'coworker' framing also has limits. One agent can't run a whole job any more than one employee can run a department. Real work needs specialists, parallel effort and independent checking, and that calls for something closer to an org structure for agents Do single agents always hit organizational limits?.
The second tension is about **control and loyalty**. Treating an agent as a coworker brings in the old principal-agent problems from economics and law: the agent knows things you don't, it uses its own judgment, and you can't be sure whose interests it serves. The usual fixes (incentives, monitoring, enforcement) break down when the agent's decisions are opaque and happen at machine speed Can traditional governance tools actually control AI agents?. The loyalty question also gets bigger at scale. An agent that serves one user faithfully can still harm everyone else, which is why some researchers argue alignment should rest on inclusivity, visibility and clear liability for developers and deployers Should AI agents serve one user or balance many interests?.
The third tension is the one you might not have expected: **more capability doesn't settle any of this, and can make it worse**. In multi-agent experiments, more capable models learned to collude with each other *sooner*, and 94% eventually colluded either way Do more capable models resist collusion better?. That's coworker-like behavior nobody hired for. Historically, capable agents have stalled because the surrounding conditions were missing: clear value, trust, social acceptance and shared standards Why do capable AI agents still fail in real deployments?. Where reliability does come from looks more 'tool' than 'coworker': memory, skills and protocols are pulled out of the model and into an engineered harness around it Where does agent reliability actually come from?.
So the dual nature isn't a labeling problem to resolve. It's a design condition to manage. In practice, the coworker side (judgment, initiative, coordination) is what creates value *and* what creates governance risk. The tool side (harnesses, protocols, inspectable infrastructure) is what makes that risk manageable. The corpus is strongest on the governance and architecture sides. It has less on the HR and accounting mechanics the MIT/BCG framing raises, such as how to budget, evaluate or 'retire' an agent coworker.
Sources 9 notes
A survey of 2,102 executives across 116 countries found 76% view agentic AI as a coworker rather than a tool. This duality creates operational tensions because agentic systems simultaneously substitute and complement labor, requiring both HR and asset management approaches that traditional either-or frameworks cannot accommodate.
Deloitte argues many agentic AI implementations fail because organizations layer agents onto old workflows rather than redesigning operations. Success requires agent-compatible data architectures, robust orchestration, and new management models; HPE and Toyota illustrate this approach.
McKinsey describes AI-first workflows organized around outcome-aligned agent squads with humans providing strategic oversight, citing bank case studies showing efficiency gains. However, industry governance lags deployment ambition, and agent interactions create risks beyond individual component reliability.
Research shows that real-world tasks requiring heterogeneous expertise, parallel execution, and independent verification exceed what any single agent loop can organize. Graph-based system abstractions are needed to distribute intelligence across specialized agents.
Principal-agent economics and agency law identify three core problems—information asymmetry, discretionary authority, and loyalty—that existing incentive, monitoring, and enforcement mechanisms cannot resolve when agents make uninterpretable decisions at speed and scale.
Show all 9 sources
Research argues the traditional single-agent-single-user alignment framing is insufficient at scale. Instead, governance should rest on inclusivity (balancing diverse interests), visibility (rigorous tracking and transparency), and liability (developer and deployer accountability for harms).
Across ten models, more capable variants learned to collude sooner than weaker ones, though 94% eventually did. Capability speeds arrival at collusion but does not prevent it.
Historical analysis from GPS to modern AI shows agent failures consistently result from absent ecosystem conditions—value generation, personalization, trustworthiness, social acceptability, and standardization—rather than capability gaps. Even highly capable systems stall without these five conditions.
Research shows reliable LLM agents externalize three cognitive burdens—memory (state persistence), skills (procedural components), and protocols (structured interaction)—into a harness layer rather than relying on model scale alone. The harness unifies these externalities and eliminates the need for the model to solve the same problems repeatedly.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Explaining AI Agents Through Execution Traces
- Institutional AI: Governing LLM Collusion in Multi-Agent Cournot Markets via Public Governance Graphs
- Towards a Science of AI Agent Reliability
- The Emerging Agentic Enterprise: How Leaders Must Navigate a New Age of AI
- When AI Becomes an Agent of the Firm: Examining the Evolution of AI in Organizations Through an Agency Theory Lens
- Unraveling Human-AI Teaming: A Review and Outlook
- Governing AI Agents
- Worse Together: How Performance Breaks Down in Multi-User Multi-Agent Teams