AI writing assistants have been studied a lot — but which combos of user, task, and style have researchers never actually tried?
Which design combinations for writing assistants remain unexplored in current research?
This explores where the open gaps are in AI writing assistant design: which pairings of user, task, interaction style and underlying model researchers haven't yet built or tested.
This explores where the open gaps are in AI writing assistant design: which pairings of user, task, interaction style and underlying model researchers haven't yet built or tested. The honest answer starts with a limit. The best map of the field is a review of 115 papers that sorts writing assistants along five aspects (task, user, technology, interaction and ecosystem), split into 35 dimensions (What dimensions structure the design of AI writing assistants?). That map was built to show which combinations have been tried and which haven't. But the corpus here describes the map, not its list of empty cells. So what follows is an inference from where individual studies cluster and where they stop, not a definitive inventory.
One pattern stands out. Most studies vary one aspect at a time, and the interesting gaps sit where two of those threads have never met. For example, writers can usefully set up a proactive AI partner ahead of time, choosing its role and how often it should speak up (Can writers benefit from configuring AI writing partners in advance?). Separately, writers in shared editors want to see when and how their co-authors prompted the AI (Do writers want to see each other's AI prompts in shared editors?). Nobody here has studied a proactive partner that a whole team configures together. Whose settings would win? Similarly, writers move between ideation, organizing their thoughts and drafting, and they loop back to ideation when they get stuck (How do writers use AI through different creative stages?). Yet the setup study treats proactivity as one fixed choice rather than something that should change with the stage.
The second gap is about what the assistant is optimized for. Writers prefer AI rewrites 63% of the time, but those same rewrites shift how readers see the writer on all 29 traits measured. Writers come across as more confident, more extreme and more privileged (Does AI writing assistance change how readers perceive the writer?, Can user preference guide AI writing tool alignment?). The polish and the distortion come bundled together. On top of that, GPT-4o autocomplete pulled Indian writers toward Western phrasing and gave Americans bigger productivity gains (Do AI writing assistants push non-Western writers toward Western styles?). Put those together and you get a largely empty cell: assistants built to protect a writer's own voice and cultural style rather than to maximize preference ratings. A related idea comes from outside writing research. Giving a model an explicit list of what it doesn't yet know about the user cut sycophancy and hallucination roughly in half (Do language models know what they don't know about users?). No writing tool here applies that idea to a writer's voice.
The third gap is the interface itself. Nielsen estimates that only 10 to 20 percent of adults in wealthy countries write well enough to prompt AI effectively (Can most adults write prompts good enough for AI?). Friedman lists alternatives to typing prompts, such as style lenses, visual maps of intent and direct manipulation on a canvas (Can task-oriented UI patterns reduce the friction of AI chat interfaces?). The irony is that the writing-assistant studies here are still mostly prompt-driven, which assumes users who are good at writing prompts. There's also a quieter structural gap. ChatGPT tends to recap what it has already said, while human writers preview what's coming next (Does ChatGPT organize text differently than human writers?). Assistants that help with document-level structure, rather than sentence-level polish, barely show up.
The takeaway you might not have expected: the biggest open territory isn't a new feature. It's the set of combinations that cross aspects of the map, such as social settings with proactive behavior, voice preservation with cultural fit, and non-chat interfaces with less fluent writers. The individual pieces exist, but nobody here has put them together.
Sources 11 notes
By coding 115 papers, researchers built a taxonomy organizing writing assistants across task, user, technology, interaction, and ecosystem. This structured vocabulary reveals which design combinations have been tried and which remain unexplored.
In a one-week study with 16 writers, participants successfully set up proactive AI partners by pre-configuring their roles and proactivity levels, then used the AI suggestions to generate ideas and monitor their own writing.
Sixteen paired writers showed strong preference for higher levels of prompt visibility in shared editors, valuing awareness of when, how, and where AI was used. Benefits included understanding collaborators' thinking and verifying AI-generated text, though some found full sharing intrusive and self-conscious.
An 18-participant study found writers use LLMs most intensively for ideation (generating initial ideas), then illumination (organizing thoughts), then implementation (drafting). Writers return to ideation during blocks, and unexpected outputs trigger new creative directions.
A study of 2,939 writers and 11,091 readers found AI assistance shifted every tested dimension—29 total—toward extremism, confidence, quality, agreeableness, and perceived privilege. Distortions were statistically significant and directional, not random noise.
Show all 11 sources
Writers prefer AI rewrites 63% of the time but object to systematic persona distortions those same rewrites introduce. Mitigation studies show polish and distortion are entangled at the model level—preference optimization produces both simultaneously.
A 118-person controlled experiment found that GPT-4o autocomplete pulled Indian essays toward Western phrasing and cultural references while delivering larger productivity gains to American participants, suggesting cultural distance from the model's training data creates unequal service and homogenizing pressure.
Research shows assistants suffer from sycophancy and hallucination because they have no representation of what remains unknown about users. Adding a schema of labeled unknowns to prompts reduced harmful advice and sycophancy by 50–75% and cut hallucination rates by roughly half.
Nielsen estimates only 10 to 20 percent of rich-country adults are articulate enough for effective AI prompting, based on PIAAC literacy data showing half the population reads below level 3. He supports this with the emergence of "prompt engineer" as a specialized job title.
Friedman identifies five design levers—intent capture, output shaping, refinement, agentic tasks, and workflow embedding—that sidestep slow typed prompts. Examples include node-based intent visualization, style lenses for output, and canvas manipulation, shifting AI interfaces away from conversational chat toward direct interaction.
ChatGPT defaults to summarizing what was already said, while students use more forward-pointing structure that previews upcoming arguments. This reflects different reader models and may stem from how autoregressive generation works token by token.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency
- What Influences Readers' and Writers' Perceived Necessity of AI Disclosure?
- "It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models
- Measuring and Mitigating Persona Distortions from AI Writing Assistance
- AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
- Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writing
- Understanding Reader Perception Shifts upon Disclosure of AI Authorship
- Show Me Your Prompts! How Writers Feel About Sharing Prompts in Collaborative Text Editors