Do users develop stable collaboration styles with web agents?
When people work alongside web-browsing agents, do they adopt consistent intervention patterns, or does behavior vary unpredictably task by task? Understanding user tendencies could reshape how agents adapt to individual working styles.
A corpus named COWCORPUS, built from "400 real-user web navigation trajectories containing over 4,200 interleaved human and agent actions" (2,748 agent action steps and 1,476 human action steps), finds that when real users work alongside a web-browsing agent, their behavior does not vary unpredictably task by task but "combine[s] into consistent higher-level collaboration strategies." The paper groups users into four styles — "Takeover, Hands-on, Hands-off, and Collaborative" — that "capture how users balance supervision, intervention, and share control with the agent." Tasks mixed "10 standard tasks from the Mind2Web dataset" with "10 free-form tasks of the participants' own choice," so the styles were observed across both benchmark and self-chosen tasks rather than one task type.
The paper traces the styles back to three recurring motivations behind individual intervention events — "error correction, preference refinement, and assistive takeover" — and argues that these motivations, repeated across a session, harden into a stable collaboration style rather than remaining one-off reactions. Step-level annotations mark "when users intervened by pausing, resuming, or overriding agent execution," which is how the four styles were derived empirically from the trajectory data rather than assumed in advance.
This taxonomy describes variation in the people being designed for, which sits upstream of two adjacent design questions already in the vault: Can users steer AI agents better by revising plans mid-execution? gives one concrete mechanism — per-step delegation — that a Collaborative-style user could lean on, while Does oversight strategy prevent risky agent actions or just catch them? compares interface strategies that structure intervention for users in general, without distinguishing style. Both studies hold the interface fixed and vary structure or risk; this one holds the task fixed and varies the person, suggesting style is a missing variable in both. It also extends the people-side concern in What UX principles do workplace users want in AI agents?, which names control as one UX principle generally wanted, by showing wanting control is not uniform but splits into at least four distinct patterns.
The excerpt does not establish whether these four styles are stable traits of a given user across different tasks and over time, or situational responses to a particular task's stakes and familiarity — the dataset captures style within a session, not whether the same person adopts a different style on a different task. It also does not report what share of the 400 trajectories fell into each of the four styles. The implication, at the strength the evidence supports, is that an agent's intervention policy may need to be conditioned on which style a given user or session exhibits, rather than built around a single generic intervention threshold applied to everyone.
Inquiring lines that read this note 6
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Can mechanistic interpretability reliably explain model reasoning and guide interventions? How can AI systems be proactive while respecting user intent?- How should AI agents adapt their interaction style across different devices and modalities?
- Should agent intervention policies adapt based on individual user collaboration style?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can models predict when users want to intervene in web agents?
If language models are trained to predict user intervention moments in real time, can they make web agents more useful by deciding when to ask for help rather than acting alone?
the sibling note on this source's modeling and deployment result, built on this taxonomy
-
Can users steer AI agents better by revising plans mid-execution?
Explores whether letting users adjust agent plans step-by-step during execution, rather than locking in plans beforehand, improves their ability to guide agent behavior without extra cognitive burden.
per-step delegation is one concrete mechanism a Collaborative-style user could rely on
-
Does oversight strategy prevent risky agent actions or just catch them?
When AI agents handle web tasks, different oversight designs might stop problems before they start—but can they help users actually intervene once a risky action is underway?
describes how an interface structures intervention, where this taxonomy describes how users differ in wanting it
-
What UX principles do workplace users want in AI agents?
A multi-method study asked business users what design principles matter most for human-AI collaboration at work. The findings prioritize oversight and reliability over convenience.
same design space of balancing user control against agent autonomy, approached by a different method
-
What action patterns emerge when humans and agents edit concurrently?
When a designer and AI agent work simultaneously on a shared canvas, what distinct ways do designers intervene in the agent's work, and how should agents respond to each type?
Extends: a concurrent-collaboration study finds five finer-grained intervention patterns, including distinct artifact vs. opportunistic takeover, beyond the four web-agent styles
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Modeling Distinct Human Interaction in Web Agents
- "When to Hand Off, When to Work Together": Understanding Concurrent Human-Agent Interaction in Shared Co-Creative Workspaces
- Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration
- Mapping the Design Space of User Experience for Computer Use Agents
- Agentic Web: Weaving the Next Web with AI Agents
- Cocoa: Co-Planning and Co-Execution with AI Agents
- AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors in Agents
- From speaking like a person to being personal: The effects of personalized, regular interactions with conversational agents
Original note title
human intervention patterns in web-agent sessions cluster into four collaboration styles — hands-off, hands-on, collaborative, and full takeover