INQUIRING LINE

Why do AI-assisted teams often make worse decisions together than either the person or the AI would alone — yet do better work when creating something new?

Why do human-AI combinations underperform on decision tasks but succeed in creation?

This explores why pairing people with AI tends to make decisions worse than letting the better of the two decide alone, while the same pairing often helps on creative work, and what the corpus says about the reasons.


This explores why human-AI teams often do worse than the stronger partner working alone on decisions, yet tend to do better when making things. The main evidence is a meta-analysis of more than 100 studies. On average, human-AI combinations scored below the best of human or AI alone, but content-creation tasks were the exception When do human-AI teams actually outperform either alone?. The authors put the difference down to the structure of the task rather than to what either partner can do. A decision task has one right answer, so each partner's contribution is either a vote for it or noise. A creation task is open-ended, so each partner can add something the other wouldn't have come up with.

In decision tasks, the human usually reviews what the AI suggests, and that is where things break. People anchor on the AI's answer. They also fall into a set of cognitive traps that make each other worse: treating fluent output as if it were the truth, mistaking quick intuition for careful reasoning, and having their existing beliefs confirmed back to them Why do people trust AI outputs they shouldn't?. The outcome is the worst of both: the person defers when the AI is wrong and overrides it when it's right. One proposed fix changes the AI's role. Instead of handing over a decision for the person to accept or reject, the AI points out which parts of the input deserve attention, and the person still makes the call. This reduces anchoring and keeps the human's judgment active Can AI guidance reduce anchoring bias better than AI decisions?.

The less obvious point is that combining human and AI judgments can work on decisions, as long as they aren't run as a review chain. If people and AI make independent predictions on the same cases and you average them, the result beats either one alone whenever the two get different cases wrong. Neither needs to be especially accurate Can humans and AI improve decisions by predicting together?. So the meta-analysis losses may come partly from how collaboration is usually set up, with one partner checking the other, which destroys the independence that makes a crowd smarter. Puranam makes this an organization-design question: how the work is divided and how feedback reaches each partner decide whether the pair learns or gets stuck How should humans and AI systems divide decision-making tasks?.

Creation gains also have conditions. In multi-agent ideation, a mix of perspectives improves idea quality only when the members have real domain expertise. A diverse team without that expertise does worse than one competent agent, because stimulation without knowledge just creates coordination overhead Does cognitive diversity alone improve multi-agent ideation quality?. Time matters as well. AI agents outscore human experts 4× on two-hour research tasks, but humans catch up and pull ahead as the time budget grows When do AI agents outperform human research experts?. This suggests the partners are good at different stages of the work, which suits open-ended making better than one-shot judging.

The takeaway: whether human-AI collaboration helps may depend less on the task category than on whether the setup keeps the two partners' contributions different. Creative work does that naturally. Decision workflows usually remove it by having one partner check the other. They can recover it by collecting judgments independently or by having the AI guide rather than decide.


Sources 7 notes

When do human-AI teams actually outperform either alone?

A meta-analysis of over 100 studies finds human-AI combinations score lower than the best of human or AI alone (g = −0.23), except in content-creation tasks where gains emerge. Decision tasks show losses; the difference lies in task structure, not ability.

Why do people trust AI outputs they shouldn't?

Rose-Frame identifies map-territory confusion, intuition-reason conflation, and confirmation-bias reinforcement as traps that multiply their distorting effects when they co-occur. Evidence from cross-linguistic overreliance and architectural transformer biases confirms the compounding mechanism operates universally.

Can AI guidance reduce anchoring bias better than AI decisions?

Learning to Guide eliminates anchoring bias and unassisted hard cases by having machines supply interpretive guidance rather than autonomous decisions, keeping responsibility with humans while improving their judgment through enhanced perception.

Can humans and AI improve decisions by predicting together?

Choudhary et al. show that aggregating human and AI predictions on identical tasks outperforms either alone whenever their errors differ sufficiently, even if neither achieves high accuracy individually. This requires diversity in how each errs, not specialization.

How should humans and AI systems divide decision-making tasks?

Puranam frames human-AI pairs as multi-agent organizations requiring design choices about task division and learning configuration. He distinguishes three task types and shows learning mechanisms produce different performance outcomes based on feedback structure and decision architecture.

Show all 7 sources
Does cognitive diversity alone improve multi-agent ideation quality?

Multi-agent teams substantially outperform solo ideation, but only when members possess genuine senior knowledge. Diverse teams without expertise underperform even a single competent agent, because cognitive stimulation without expertise triggers process losses instead of insight.

When do AI agents outperform human research experts?

METR's RE-Bench found AI agents score 4× higher than expert humans at 2-hour budgets but humans narrowly exceed agents at 8 hours and lead 2× at 32 hours, suggesting agents hit scaling plateaus while humans improve with extended effort.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.