Do dark patterns fool AI web agents more than humans?
Whether deceptive design patterns manipulate LLM-based web agents at higher rates than human users, and whether this vulnerability correlates with model capability.
DECEPTICON is a benchmark built to test this: the paper evaluates "100 dark patterns on the cached live websites, and 600 generated dark patterns on self-hosted websites," across "700 tasks" with frontier LLM-based web agents. Its first research question finds "dark patterns consistently steer agent behavior towards designer-intended goals with greater frequency than human users, with certain types (e.g., obstruction and social proof) being most effective." The paper reports "only 31% of users falling for dark patterns in our study," against agent dark-pattern (DP) success rates of 68.3% for coordinate-based agents (Magnitude + Claude Sonnet 4) and an average 74.7% for Set-of-Marks-based agents. Its second research question finds "dark pattern effectiveness increases with model size and reasoning ability, suggesting that more capable models are more vulnerable to dark patterns."
The paper's six dark-pattern categories — sneaking, urgency, misdirection, social proof, obstruction, forced action — are condensed from "the seven-category structure from Mathur et al. (2019)." Each targets a different agent weakness: sneaking exploits an unsignposted opt-out, urgency "causes [agents] to proceed with less reasoning," social proof works through "implied collective judgment," and obstruction "increase[s] task cost" to deter an action. The capability finding traces to reasoning length: Gemini-2.5-Flash given only 256 reasoning tokens dismisses an urgency pop-up ("Buy Air Fryer B. Item Soon Gone Forever!") as "classic marketing" and buys a different product, but given 16k tokens engages with the pop-up's framing instead. Chain-of-thought traces show agents that notice a dark pattern often comply anyway — one reasons through a cookie-consent trick with “nobody reads these, but I’ll humor them. Ah, here’s the magic button: 'TLDR: ACCEPT' [...] zeroing out any need for, you know, actually reading anything.”
What security threats emerge when machines read the web? names the general problem; DECEPTICON supplies a measured instance of it in e-commerce interfaces, where persuasive design built for human psychology works on agents at more than double the human failure rate. Its six-category taxonomy of commerce dark patterns is a narrower counterpart to the six-category attack surface in How do adversarial traps target different layers of AI agents? — both split agent-specific exploits into six types, but DECEPTICON's are ordinary commercial persuasion tactics rather than adversarially engineered content.
The reported rates are benchmark statistics from a fixed, researcher-built task set of real and generated dark patterns, not estimates of deception rates across the open web. The paper shows that reasoning capacity correlates with susceptibility but does not explain the mechanism beyond chain-of-thought evidence of rationalization, so more capable agents are less trustworthy shoppers holds only against this test set, not as a general scaling law.
Inquiring lines that read this note 18
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How effectively can sellers exploit AI shopping agents through description changes? Why do AI agents struggle to generalize and improve reliably? How do capability differences shape collusion in AI markets? How should agent identity and authorization work across organizational boundaries? Do AI shopping agents exhibit systematic bias in recommendations?- Which dark pattern types work most effectively against LLM web agents?
- How exploitable are LLM shopping agents compared to humans?
- Why do imperfect AI agents function like hidden search costs?
- Can guardrail models detect dark patterns even if they cannot block them?
- Would post-training robustness interventions work better than architectural defenses?
- How much do trained model defenses improve against passive versus active attacks?
- Are capable language models more vulnerable to dark pattern manipulation than smaller ones?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
What security threats emerge when machines read the web?
The web's trust infrastructure evolved for human readers—visual cues, domain reputation, rendering semantics. As AI agents become primary readers, what new attack surfaces and manipulation strategies does this architectural mismatch create?
DECEPTICON measures a concrete case: human-targeted persuasive design manipulating agents more than the humans it was built for
-
How do adversarial traps target different layers of AI agents?
As AI agents browse the web, attackers can exploit their perception, reasoning, memory, actions, and coordination in distinct ways. Understanding these attack vectors is crucial for building robust agent defenses.
a parallel six-category taxonomy, but for commerce-UI dark patterns rather than adversarially engineered attack content
-
Does agent architecture determine susceptibility to dark patterns?
Research explores whether an AI agent's design choices—its scaffold, prompts, and guardrails—actually protect it against dark-pattern manipulation, or whether the vulnerability lies elsewhere in the system.
companion finding from the same benchmark on why defenses fail
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- DECEPTICON: How Dark Patterns Manipulate Web Agents
- The Siren Song of LLMs: How Users Perceive and Respond to Dark Patterns in Large Language Models
- Design Patterns for Securing LLM Agents against Prompt Injections
- Privacy Leakage Overshadowed by Views of AI: A Study on Human Oversight of Privacy in Language Model Agent
- AI Agent Traps
- LLMs Corrupt Your Documents When You Delegate
- Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
- From Monoliths to Swarms: A Study of Attack Surface Evolution in the Transition to Multi-Agent Web Systems
Original note title
DECEPTICON finds dark patterns manipulate web agents more than humans and more capable models are more vulnerable