Can process data distinguish AI delegation from ordinary collaboration?
When students or writers use AI tools, their work leaves traces in keystroke logs and editor telemetry. Can these process signatures reliably separate wholesale delegation from permitted collaborative use?
The paper argues that AI assistance carries a temporal signature that holds across mediums: "AI contributions arrive in bursts far outside the author's own baseline" in both writing and programming, with paired effect sizes of dz = 1.13 and 3.54. The evidence comes from three public corpora. CoAuthor supplies 1,447 keystroke-level co-writing sessions, RealHumanEval supplies editor telemetry from 243 programmer records, and a pre-LLM CS1 corpus of 5.1 million keystrokes serves as a human-only baseline. The comparison is among minimal-AI work, collaborative AI use, and simulated wholesale delegation.
The mechanism is in how text arrives, not in what it says. Concentrated production sits far from a person's own typing rhythm, so a process log can register it without any detector reading the finished artifact. The authors frame this through the Learning Visibility Framework: what AI removes from assessment is visibility into the learning process, so assessment needs "process-based evidence alongside outcomes" because final artifacts and product-only AI detectors are unreliable. The result is deliberately asymmetric. Ordinary collaboration is "only weakly separable" from minimally assisted work, and at most 0.5% of real work was classed as delegation, while wholesale delegation produces "a categorical signature." The authors call the weak separability of collaboration the desirable outcome, since students using AI as permitted should not be flagged. In their words, process evidence "flags delegation, not assistance." The abstract also reports that engagement diverges by medium: 93% of AI-inserted characters survived to writers' final documents, against only 14% of accepted code suggestions surviving intact.
Against the nearest notes, this paper supplies an observability layer that the others lack. Can humans detect AI text if machines can measure it? locates the difference in the finished text, which humans cannot perceive, and this paper starts from the same weakness of product-level detection and moves to process evidence. Does AI assistance actually harm the way developers learn? found that delegation-style patterns preserve less learning. The temporal signature offers a way to see delegation-like production in a log, though the excerpt never links the signature to learning. Does ownership framing change how much writers rely on AI? also draws on CoAuthor data, so the two together show that reliance is visible in the same corpus from the framing side and from the timing side.
The excerpt is explicit about its limits. The delegation condition is simulated, and "the separability is partly by construction, since concentrated production defines the simulated behavior." The authors state that the result "establishes sensitivity and observability, not prevalence or field accuracy." The excerpt does not describe how the simulation was built, why code suggestions survive so much less often than inserted text, or whether burst timing predicts any learning outcome. It states only two of the three findings the abstract announces. The defensible reading is narrow: a burst signature makes wholesale delegation observable in process data, and a flag can indicate concentrated production but not misconduct or lost learning.
Inquiring lines that read this note 5
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does the generation-verification gap limit what we can measure about AI reasoning? How should designers communicate what AI systems truly are and can do? Why do people disclose to AI systems despite their artificial nature?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can humans detect AI text if machines can measure it?
AI-generated text shows measurable differences from human writing across multiple linguistic dimensions, yet human judges consistently fail to identify it. Why does the gap between what is measurable and what is perceptible exist?
both find product-level inspection inadequate; this paper turns to process data as the alternative
-
Does AI assistance actually harm the way developers learn?
When developers use AI tools while learning new programming concepts, does it impair their ability to understand code, debug problems, and build lasting skills? Understanding this matters for how we deploy AI in education and training.
that note ties delegation patterns to weaker learning; this one makes delegation visible in process logs without measuring learning
-
Does ownership framing change how much writers rely on AI?
When writers believe they own the final output versus composing for themselves, do they use AI suggestions differently? Understanding this matters because it reveals whether reliance is driven by tool capability or by how tasks are framed.
also uses CoAuthor data, approaching reliance through ownership framing rather than timing
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Does AI Assistance Leave a Temporal Fingerprint? Detecting Overreliance in AI-Assisted Writing and Programming
- Evidence-centered Assessment for Writing with Generative AI
- LLMs Corrupt Your Documents When You Delegate
- The LLM Fallacy: Misattribution in AI-Assisted Cognitive Workflows
- Show Me Your Prompts! How Writers Feel About Sharing Prompts in Collaborative Text Editors
- What Does the Credential Still Certify? Cognitive Stewardship for AI-Mediated Education
- Who Delegates to AI? Evidence from Agent Configurations in Github
- Quantifying Human-AI Synergy
Original note title
AI assistance leaves a temporal signature in both writing and programming — process data flags wholesale delegation, not ordinary collaboration