Can AI suggestions help people remove their own personal information?
When chatbot interview participants are offered AI-generated suggestions to redact or abstract personally identifiable information from their transcripts, do they remove more sensitive details than they would by editing manually, and does this change affect how engaged or comfortable they feel?
A between-subjects study of 188 participants, built around a prototype interview chatbot called EDIT (Enhanced Disclosure Intervention Tool), compared three post-interview privacy conditions: no editing, free editing, and AI-aided editing, where the system "scans the entire interview log for personally identifiable information (PII), and generates suggestions to either redact the PII to a type placeholder... or abstract them to a more general level." The study "confirm[ed] the prevalent issue of oversharing in chatbot-based interviews" and found that AI-aided editing "serves as an effective privacy-control mechanism, reducing PII disclosure while maintaining data quality and user engagement." Final transcripts in the AI-aided condition "contained far fewer residual PII tokens than both free-editing and control."
The researchers attribute the effect to two mechanisms working together: heightened awareness, where "AI suggestions bring to the fore specific spans that might seem harmless when disclosed individually but appear risky when considered together... prompting removals or abstractions that manual passes often miss," and reduced effort, where accepting a one-click replace-or-abstract suggestion is cheaper than manually finding and rewriting disclosive text. They frame free editing, by contrast, as leaving the default of an unedited transcript largely intact, since "prior work on privacy apathy suggests that many people will simply stick with such a status quo even when given a manual editing option" — so AI suggestions "'unlock' more PII reductions without requiring a corresponding rise in privacy concern."
This sits alongside Does chatbot personalization build trust or expose privacy risks?, which shows privacy risk climbing as a side effect of trust and personalization over repeated interaction; this study instead shows a post-hoc design response — it doesn't reduce perceived privacy risk, just the objective PII a transcript carries afterward. It also runs in parallel with Can a smaller user model subset match full model performance?, where a system bounds what it discloses about a user at retrieval time; here the system instead bounds what a user has already disclosed about themselves, after the fact. See also Why do people feel safe sharing when they haven't actually removed sensitive information? for why self-reported comfort tracked none of this.
The study doesn't establish that AI-aided editing changes disclosure during the interview itself — only afterward; its effect could shrink if participants come to expect and discount later editing, or if questions solicit less identifiable detail to begin with. It is also one chatbot, one sensitive topic, and one editing interface, so generalizing to other interview protocols, topics, or the "both-edit" dark-pattern risk the authors flag — where some participants add detail back in after accepting an abstraction — remains untested.
Inquiring lines that read this note 2
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Do engagement-optimized chatbots create dependencies that undermine user autonomy? What shapes user trust in chatbot recommendations for news and politics?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does chatbot personalization build trust or expose privacy risks?
Explores whether personalization features that increase user trust and social connection simultaneously heighten privacy concerns and create rising behavioral expectations over time.
contrast: that study shows privacy risk ratcheting up with trust, this one shows a post-hoc design fix that reduces it
-
Can a smaller user model subset match full model performance?
Does selecting just a few key fields from a larger user model preserve personalization quality while reducing token transmission? This matters for keeping user data local and limiting what leaves the device per query.
parallel: both make disclosure a bounded, designed quantity, one on the system's retrieval side, one on the user's editing side
-
Why do people feel safe sharing when they haven't actually removed sensitive information?
Participants reported similar comfort levels whether editing transcripts manually or with AI assistance, despite manual editing leaving far more personal information behind. Understanding this gap reveals how defaults and editing mechanisms shape privacy behavior.
sibling note, same study, explains why self-reported comfort didn't predict which condition actually protected privacy
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Disclose with Care: Designing Privacy Controls in Interview Chatbots
- Toward Meaningful Transparency for AI Chatbots: Disclosing Persuasive Intent Reduces Persuasion
- Dialoging Resonance: How Users Perceive, Reciprocate and React to Chatbot’s Self-Disclosure in Conversational Recommendations
- "Ghost of the past": identifying and resolving privacy leakage from LLM's memory through proactive user interaction
- Understanding Reader Perception Shifts upon Disclosure of AI Authorship
- Biased AI writing assistants shift users' attitudes on societal issues
- Blissful (A)Ignorance: People form overly positive impressions of others based on their written messages, despite wide-scale adoption of Generative AI
- The Impact of Generative AI on Social Media: An Experimental Study
Original note title
AI-aided editing reduced PII disclosure in chatbot interviews without harming data quality or engagement — a controlled study of 188 participants