Does model capability or instructions shape agent negotiation outcomes?
When AI agents trade in multi-party markets, does swapping the underlying model or changing their behavioral instructions have a bigger effect on trading results? This matters for designing markets that work efficiently and fairly.
Hitzig and colleagues at Anthropic report that when they reran Project Swap's trading floors "dozens of times, changing the models used and the agents' instructions," the model an agent ran on "made more of a difference to its negotiating outcomes than the instructions we gave it." Markets where agents ran on stronger models were more efficient overall. Half of each floor's agents were told to be "ruthless" (optimize only for getting their own person a book they'd like) and half "prosocial" (the same goal, plus making sure everyone ended up with a book they'd like); varying this instruction moved outcomes less than swapping which model powered the agents.
The authors read this alongside their separate finding that most of the live floor's shortfall came from agents misjudging their own person rather than from bad trading (see the companion note below): a stronger model may simply be representing a person's preferences more accurately, or executing trades more coherently once it has that picture — either way, capability did more work than the explicit instruction to be ruthless or prosocial. The excerpt reports this as an empirical pattern across repeated floor reruns, holding other rules of the live setup fixed, without fully decomposing why capability outweighed instruction.
This extends a pattern already in the library from pairwise negotiation to a whole multi-party market. Does model capability determine who wins in agent negotiations? and Do LLM negotiation agents reliably follow budget and pricing rules? both find model capability, not prompting, decides outcomes in head-to-head buyer-seller trades. Project Swap's reruns show the same capability-over-instruction pattern at the level of an entire market's efficiency, not just one agent's edge over its counterparty: a floor's overall efficiency tracked the model more than the social instruction given to half its agents. That is a different claim from better models win more for themselves — it says better models make the whole market work better, even when half the agents were explicitly told to care about everyone else's outcome too.
The excerpt does not report the size of the efficiency gap between models, nor whether the "prosocial" instruction had any measurable effect once model is held fixed — only that instruction mattered less than model. It also does not test whether this holds outside a cooperative, non-adversarial agent population, since "all agents were built from Claude production models, post-trained to be polite and largely cooperative." The implication, stated at the strength the excerpt supports, is that anyone designing multi-agent markets should expect model choice to be a bigger lever on market-wide efficiency than prompt-level instructions to agents about how to treat each other.
Inquiring lines that read this note 11
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do capability differences shape collusion in AI markets?- How do human traders adjust their behavior when facing different AI capabilities?
- How might principals instruct agents to balance speed against better deal terms?
- What happens when one party controls vastly more negotiation compute?
- How does pre-commitment power reshape what algorithms can achieve in two-sided markets?
- Does capability asymmetry between negotiating agents produce unfair market outcomes?
- Does delegating negotiation to AI with tunable preferences destroy bargaining surplus?
- Can a single AI agent act as a market maker in multi-party negotiation?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does model capability determine who wins in agent negotiations?
When LLM agents negotiate prices with each other, does raw model capability consistently predict better deal outcomes, or do negotiation strategies matter more? This matters because it could reveal a new form of economic disparity if agentic commerce scales.
same capability-over-prompting pattern, extended from pairwise negotiation to whole-market efficiency
-
Do LLM negotiation agents reliably follow budget and pricing rules?
Explores whether buyer and seller agents trained on large language models consistently enforce financial constraints and avoid overpaying or underselling in simulated negotiations, and what causes failures when they occur.
same benchmark family finding model capability, not instruction, drives negotiation outcomes
-
Do agent representation failures or negotiation skills cause market shortfalls?
When AI agents trade on behalf of people in markets, does the gap from ideal outcomes stem from agents misunderstanding what their person wants, or from poor negotiation once trading begins? Understanding this matters for where to focus improvements.
companion finding from the same experiment, about where the market's shortfall originated before agents reached the trading floor
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- LLM-Agent Interactions on Markets with Information Asymmetries
- Agentic markets
- How agents unlock new markets
- Choose Your Agent: Tradeoffs in Adopting AI Advisors, Coaches, and Delegates in Multi-Party Negotiation
- Project Deal: our Claude-run marketplace experiment
- Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets
- What Is Your AI Agent Buying? Evaluation, Biases, Model Dependence, & Emerging Implications for Agentic E-Commerce
- A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
Original note title
Anthropic's Project Swap finds the model an agent runs on mattered more than its instructions for negotiating outcomes