Further Explorations on the Use of Large Language Models for Thematic Analysis. Open-Ended Prompts, Better Terminologies and Thematic Maps

Paper · Source
Reading and SummarizationDomain Specialization in LLMs

There is a nascent area, where scholars are approaching thematic analysis (TA) using LLMs, following the six phases developed by BRAUN and CLARKE (2006). TA is a qualitative method of analysis where the researcher labels (codes) portions of data with relevant meaning and then organises these codes/labels into patterns (the themes). BRAUN and CLARKE stipulated that TA encompasses the following phases: 1. familiarisation with the data; 2. initial coding; 3. identification of themes; 4. revision of themes; 5. renaming and summarising of themes; and 6. write-up of the results.

Lines of inquiry this paper opens 24

Research framings built by reading the notes related to this paper — the questions it feeds into.

How do language models reason about pragmatics and cooperation unlike humans? Should benchmarks treat annotation disagreement as signal rather than noise? Can automated systems effectively detect flaws in AI-generated research? Can AI reviewers distinguish scientific merit from rhetorical persuasion in paper evaluation? Is LLM hallucination an inherent limitation or ultimately preventable? What human judgment remains essential for autonomous AI research systems? Does knowing an AI wrote something change how audiences evaluate it? How do AI hiring systems change candidate evaluation and fairness? How can research institutions better incentivize verification and rigor?