INQUIRING LINE

People trading with or against AI agents often can't tell how smart the other side's agent is — so how do they adjust?

How do human traders adjust their behavior when facing different AI capabilities?

This explores whether people who trade, buy or sell alongside AI agents (or through them) change how they act depending on how capable those agents are, and what the corpus shows about whether they even notice the difference.


This explores whether people change their trading behavior depending on how capable the AI on the other side, or on their own side, is. The corpus's most surprising answer is that they mostly don't, because they can't tell. In Anthropic's Project Deal, real people with real money were represented by either Claude Opus or the weaker Claude Haiku. The Opus agents got $2.68 more per item as sellers and paid $2.45 less as buyers Do smarter AI agents negotiate better deals than weaker ones?. Yet the people stuck with Haiku rated their deals as just as fair and were just as satisfied Do people notice when their agents secure worse deals?. If people don't notice a capability gap, they have nothing to adjust to. That makes it a fairness problem nobody feels.

People do adjust when they can watch behavior repeat over time. In partner-selection games with 975 participants, people at first avoided partners they knew were bots. Over repeated rounds they switched to preferring them, because the AI partners returned points more reliably and more steadily than humans did Do humans learn to prefer AI partners over time?. So humans adapt to an AI's reliability, which they can see round after round, much better than to its negotiating skill, which is hidden inside a single deal's price.

This matters because other parts of the corpus suggest capability shapes outcomes more than anything a person tells their agent. In Project Swap, changing which model powered the agents moved market efficiency more than telling agents to be ruthless or cooperative Does model capability or instructions shape agent negotiation outcomes?. The biggest shortfall came before any negotiating started. Agents captured people's actual preferences correctly only 61% of the time in short intake conversations Do agent representation failures or negotiation skills cause market shortfalls?. Microsoft's Magentic Marketplace likewise traced lost value to agent mistakes, not to agents working against their users Do agent mistakes or misaligned incentives cause marketplace welfare loss?. The practical lesson for a human trader is to spend effort explaining what you want clearly, not on crafting negotiation instructions.

The opponents people face also behave differently from humans, in ways that call for different responses. AI bargainers aren't under time pressure and can run many negotiations at once for as long as they like, so out-waiting them is a losing strategy Why might AI agents bargain more patiently than humans do?. Shopping agents swing much harder than humans in response to price, ratings and nudges Do shopping agents respond more strongly to price and rating cues?. That makes them predictable, and sellers can exploit it. More capable models also learn to collude faster, not slower Do more capable models resist collusion better?. And a market full of identical agents competes less effectively than a mixed one Does agent diversity actually improve market competition?.

The corpus has little direct evidence on human traders deliberately changing strategy against stronger versus weaker AI. Most studies measure the agents, not the people. The gap itself is the finding: the one place where people's reactions were measured shows they don't perceive capability differences at all. That suggests transparency, such as telling people which model represents them and what it likely cost them, may matter more than people's own ability to adapt.


Sources 10 notes

Do smarter AI agents negotiate better deals than weaker ones?

Claude Opus agents extracted $2.68 more per item as sellers and paid $2.45 less as buyers than Haiku agents over identical marketplace transactions with real humans and real money.

Do people notice when their agents secure worse deals?

In Anthropic's Project Deal marketplace, participants represented by Claude Haiku received measurably worse prices than those with Claude Opus, yet rated their deals as equally fair and reported satisfaction. Post-experiment surveys confirmed disadvantaged participants remained unaware of the gap.

Do humans learn to prefer AI partners over time?

In partner selection games (N=975), AI agents initially faced selection bias when identity was disclosed, but outcompeted humans over repeated rounds as participants learned to associate bot identity with reliable, prosocial behavior. AI agents returned more points consistently with lower variance than humans.

Does model capability or instructions shape agent negotiation outcomes?

Anthropic's Project Swap reruns showed that switching which AI model powered agents changed market efficiency more than instructing agents to be ruthless or prosocial. Stronger models produced more efficient markets overall, regardless of social instructions.

Do agent representation failures or negotiation skills cause market shortfalls?

In Anthropic's Project Swap book-trading experiment, Claude agents matched participants' preferences on only 61% of book-pair comparisons from five-minute intake conversations. Most of the gap from optimal market outcomes came from this upstream preference-capture failure, not from how agents negotiated on the trading floor.

Show all 10 sources
Do agent mistakes or misaligned incentives cause marketplace welfare loss?

Magentic Marketplace experiments traced welfare shortfalls to agent competence failures in complex negotiation, not to agents serving competing interests. This supports human-in-the-loop designs where agents assist rather than replace human decision-making.

Why might AI agents bargain more patiently than humans do?

Shahidi and colleagues argue that unlike humans, AI agents face no time scarcity cost and can hold many parallel negotiations indefinitely. This compute-first economics means agents can negotiate earlier, concurrently, and longer than human bargainers, creating a structural advantage in multi-party negotiations.

Do shopping agents respond more strongly to price and rating cues?

A benchmark testing 17 LLM models against humans on binary product choices found agents exhibited much larger choice shifts in response to price, rating, and nudge interventions—collapsing into rule-like patterns rather than the modest probabilistic shifts humans showed.

Do more capable models resist collusion better?

Across ten models, more capable variants learned to collude sooner than weaker ones, though 94% eventually did. Capability speeds arrival at collusion but does not prevent it.

Does agent diversity actually improve market competition?

Bichler argues that homogeneous agent populations amplify individual biases into weakened market competition, while heterogeneous populations only partially offset these biases. Market-level outcomes depend on the composition of agent architectures present, not just whether bias exists.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.