What blocks effective human-AI teams from performing well?
Research explores why human-AI collaboration remains ad hoc and underperforming. Two key barriers emerge: misalignment between AI systems and human values, plus organizational resistance to treating AI as genuine teammates rather than tools.
"Unraveling Human-AI Teaming: A Review and Outlook" argues that human-AI collaboration remains "ad hoc, often resulting in underwhelming performance" because the information-systems literature still "mainly treats AI as a tool rather than a nearly full-fledged teammate." The authors name two research gaps: first, "a significant challenge in designing AI agents that align with human values and objectives," which they trace partly to the fact that "humans themselves often struggle to explicitly articulate their goals and objectives"; second, "the limited integration of AI's full capabilities into collaborative workflows," since "many still view AI agents as static tools rather than adaptive, knowledge-enhancing partners," reinforced by "behavioral resistance and inertia" among people reluctant to treat AI as a genuine team member. To address both gaps the paper proposes a research outlook built around four aspects of human-AI teaming: "formulation, coordination, maintenance, and training."
The theoretical scaffold is Team Situation Awareness (SA) theory (Endsley 1995), which the paper extends rather than discards. Individual SA already has three levels — perception, comprehension, and projection — and the classic model adds "shared SA," defined as "the degree to which team members possess the same SA on shared SA requirements," resting on a "shared mental model." The paper's extension is to add "role specification and role fluidity" to this model so it covers AI teammates: role specification ensures "all team members, including AI, clearly understand their specific tasks," while role fluidity is the "adaptability, open communication, and shared responsibilities" needed to "respond effectively to dynamic and uncertain environments." The authors treat trust as the mechanism that makes this work in practice, citing Salas et al. (2017) that trust "is essential to enhancing information sharing and reducing communication hesitancy," so that trust growing as AI "contributions become more accurate and contextually relevant" should enable "smoother workflows and more confident task delegation."
This sits as a theoretical companion to two nearby position papers rather than a test of either. Where Does machine agency exist on a spectrum rather than binary? locates AI's role on a spectrum from passive tool to cooperative partner at the level of individual human-machine interactions, this paper works at the team level, asking what shared awareness and role structure a team needs once AI sits somewhere past "passive tool" on that spectrum. It also echoes the claim in Should AI systems stay collaborative rather than fully autonomous? that human involvement remains structurally necessary — but where that paper grounds the claim in autonomous agents' reliability and transparency failures, this paper grounds the same conclusion in Team SA theory's requirement for shared mental models and trust-building, a different argument for a similar position. The four-aspect agenda (formulation, coordination, maintenance, training) also offers a theory-first complement to the empirically derived role typologies in Do humans and AI divide labor differently in knowledge work? and How do AI novelty and scope shape employee relationships?, both of which describe role divisions that could be read as instances of the "role specification and role fluidity" this paper proposes in the abstract.
The excerpt is explicitly "a foundational agenda for future research," not a tested model — the role-specification and role-fluidity extensions to Team SA are proposed, not validated against any human-AI team, and the paper names the value-alignment gap without resolving it. The Discussion section also flags, citing Dell'Acqua et al. (2023) and Fügener et al. (2021), that "over-reliance on AI may suppress human creativity, learning, and critical thinking" as trust grows — a risk the paper raises as a tension to manage rather than something it measures. The implication is that the four-aspect research outlook is best read as a set of hypotheses for future human-AI teaming studies to test, not evidence that current AI deployments already achieve shared situation awareness with their human teammates.
Inquiring lines that read this note 4
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How should control and autonomy be allocated in human-AI collaboration? Why do human-AI teams underperform compared to their individual components? What organizational practices enable successful AI tool adoption?Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does machine agency exist on a spectrum rather than binary?
Rather than viewing AI as either autonomous or controlled, does machine agency actually operate across five distinct levels from passive to cooperative? Understanding this spectrum matters because it shapes how users calibrate trust and control expectations.
both frame AI's teaming role as a move from passive tool toward active collaborator, at individual vs. team-level scales
-
Should AI systems stay collaborative rather than fully autonomous?
Explores whether keeping humans in the loop with AI agents is more reliable than pursuing full autonomy. Investigates whether collaboration solves problems that autonomous systems structurally cannot.
reaches a similar human-stays-involved conclusion from reliability failures rather than Team SA theory
-
Do humans and AI divide labor differently in knowledge work?
How do professionals actually split decision-making and control when collaborating with GenAI on the same task? Research on consultants using GPT-4 suggests the answer depends on who picks what gets done and how.
an empirical role typology that could instantiate this paper's proposed role specification and role fluidity
-
How do AI novelty and scope shape employee relationships?
Makarius and colleagues ask whether different types of AI systems—varying in how new they are and how broadly they reshape work—create systematically different kinds of relationships between employees and technology. Understanding these patterns could help organizations anticipate integration challenges.
another typology of human-AI relationship structure, complementary to this paper's theory-first framework
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Unraveling Human-AI Teaming: A Review and Outlook
- Complementarity in Human-AI Collaboration: Concept, Sources, and Evidence
- When combinations of humans and AI are useful: A systematic review and meta-analysis
- Cyborgs, Centaurs and Self-Automators: The Three Modes of Human-GenAI Knowledge Work and Their Implications for Skilling and the Future of Expertise
- Quantifying Human-AI Synergy
- Sociotechnical Envelopment of Artificial Intelligence: An Approach to Organizational Deployment of Inscrutable Artificial Intelligence Systems
- Roles of Artificial Intelligence in Collaboration with Humans: Automation, Augmentation, and the Future of Work
- How Well Can AI Do Strategy? Empirical Benchmarking Using Strategy Simulations
Original note title
human-AI teaming research agenda spans formulation coordination maintenance and training built on an extended team situation awareness model