Using AI to brainstorm makes everyone's ideas converge, but using it to polish your own ideas doesn't. Where should it go?
How should AI be integrated into creative workflows to protect collective diversity?
This explores where in a creative process AI should and shouldn't be used so that a group of people still produces a wide range of ideas, not the same ones.
This explores where in a creative process AI should and shouldn't be used, so that a group of people still produces a wide range of ideas. The corpus gives a specific answer: put AI after the idea, not before it. In a preregistered experiment, AI-generated ideas reduced collective diversity for every writer, while AI that refined ideas people had already written left diversity intact Does AI assistance homogenize or preserve creative diversity?. Non-native English speakers contributed more diverse ideas than native speakers. Only AI ideation erased that advantage. So the rule is about the stage of the workflow, not about how much AI gets used.
The difficulty is that ideation is where writers lean on AI most. In a study of 18 writers, LLM use was heaviest during ideation, then organizing thoughts, then drafting. Writers also returned to ideation whenever they were blocked, and unexpected outputs sent them in new directions How do writers use AI through different creative stages?. The risky moment is the stuck moment, when an AI suggestion is most tempting. A diversity-protecting workflow has to plan for that moment, not just assume writers will hold off.
Switching models or adding more of them doesn't fix this. INFINITY-CHAT tested 70+ models on 26K open-ended queries and found an 'Artificial Hivemind'. Different models independently produced strikingly similar or identical answers, because their training data and alignment procedures overlap Do different AI models actually produce diverse outputs?. The sameness is also hard to spot from inside a single chat. Each user gets an output that looks personalized, so the homogeneity only shows up in aggregate Does AI homogenize culture the way mass media did?. Simulated crowds of AI agents don't rescue you either: teams with varied perspectives but no real domain expertise did worse than one competent agent Does cognitive diversity alone improve multi-agent ideation quality?. One partial counter-move is inside a single model. Structuring its reasoning as a dialogue between distinct voices produced more varied problem-solving strategies than monologue Can dialogue format help models reason more diversely?. That result is about reasoning tasks, not group creativity, so it points a direction without proving anything. In practice, the variety has to come from people with real expertise, and AI should be supporting them.
There is one more reason to keep the idea in human hands. AI can produce the finished form of an intellectual product without the person's own reasoning behind it Does AI separate intellectual form from the thinking behind it?. Refining someone's idea keeps their thinking in the piece, while generating the idea replaces it.
Two visibility tools show up in the corpus. Paired writers strongly preferred shared editors that reveal each other's prompting, valuing awareness of when, how, and where AI was used, though some found full sharing intrusive Do writers want to see each other's AI prompts in shared editors?. Process data can also flag AI use. AI contributions arrive in concentrated bursts outside an author's normal rhythm, so wholesale delegation is detectable, while ordinary collaborative use looks the same as minimal assistance Can process data distinguish AI delegation from ordinary collaboration?. Together they could catch the case of AI writing the idea, but not quieter influence. The corpus doesn't test whether either tool actually preserves diversity, so treat them as ways to see what's happening, not as proven safeguards.
Sources 9 notes
In a preregistered experiment, AI-generated ideas reduced collective diversity for all writers, while AI that refined existing ideas kept diversity intact. Non-native English speakers contributed more diversity than native speakers, but only AI ideation erased this advantage.
An 18-participant study found writers use LLMs most intensively for ideation (generating initial ideas), then illumination (organizing thoughts), then implementation (drafting). Writers return to ideation during blocks, and unexpected outputs trigger new creative directions.
INFINITY-CHAT analyzed 70+ models across 26K open-ended queries and found an "Artificial Hivemind" effect: models independently generate strikingly similar or identical responses due to overlapping training data and alignment procedures, undermining the diversity benefits of model ensembles.
AI mass-generates similar flows disguised as personalized outputs, suppressing novelty more deeply than pre-stamped commodities because contextual customization makes homogeneity invisible to individual users. Evidence: independent LLMs converge on similar outputs despite nominal competition.
Multi-agent teams substantially outperform solo ideation, but only when members possess genuine senior knowledge. Diverse teams without expertise underperform even a single competent agent, because cognitive stimulation without expertise triggers process losses instead of insight.
Show all 9 sources
DialogueReason, which structures a single model's internal reasoning as dialogue between distinct agents in separate scenes, overcomes monologue reasoning's fixed-strategy and fragmented-attention weaknesses, especially on tasks requiring multiple problem-solving approaches.
Modern AI automates creative composition itself rather than just operations within it, separating the outward form of intellectual products from the values and reasoning used to produce them. This mechanism allows exchange value to float free from use value.
Sixteen paired writers showed strong preference for higher levels of prompt visibility in shared editors, valuing awareness of when, how, and where AI was used. Benefits included understanding collaborators' thinking and verifying AI-generated text, though some found full sharing intrusive and self-conscious.
Analysis of writing and programming corpora shows AI contributions arrive in concentrated bursts outside authors' baseline rhythms, creating a categorical signature for wholesale delegation while leaving collaborative assistance indistinguishable from minimally assisted work.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Human diversity fuels collective creativity that large language models cannot simulate or sustain
- Has the Creativity of Large-Language Models peaked? —an analysis of inter- and intra-LLM variability —
- ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs
- Evidence-centered Assessment for Writing with Generative AI
- Does AI Assistance Leave a Temporal Fingerprint? Detecting Overreliance in AI-Assisted Writing and Programming
- Show Me Your Prompts! How Writers Feel About Sharing Prompts in Collaborative Text Editors
- Beyond Brainstorming: What Drives High-Quality Scientific Ideas? Lessons from Multi-Agent Collaboration
- What Does It Take to Be a Good AI Research Agent? Studying the Role of Ideation Diversity