Further Explorations on the Use of Large Language Models for Thematic Analysis. Open-Ended Prompts, Better Terminologies and Thematic Maps
There is a nascent area, where scholars are approaching thematic analysis (TA) using LLMs, following the six phases developed by BRAUN and CLARKE (2006). TA is a qualitative method of analysis where the researcher labels (codes) portions of data with relevant meaning and then organises these codes/labels into patterns (the themes). BRAUN and CLARKE stipulated that TA encompasses the following phases: 1. familiarisation with the data; 2. initial coding; 3. identification of themes; 4. revision of themes; 5. renaming and summarising of themes; and 6. write-up of the results.
Lines of inquiry this paper opens 24
Research framings built by reading the notes related to this paper — the questions it feeds into.
How do evaluation biases undermine LLM quality assessment systems? How should dialogue systems best leverage conversation history for retrieval? What makes specific clarifying questions more effective than generic ones? How do formal dialogue structures reveal conversation coherence mechanisms? How faithfully do LLMs reflect their actual reasoning in outputs and explanations?- How does era sensitivity in legal cases compound with context length failures?
- How does context complexity affect LLM performance on temporal reasoning tasks?
- Why do medical and mathematical tasks require fundamentally different model capabilities?
- Why does contextual judgment matter more in law and medicine than in mathematics?
- What causes models to develop domain capability cliffs after specialization?
- How does over-specialization create capability cliffs outside target domains?
- What access constraints allow description-based adaptation but block conventional techniques?
- Do different domains require different types of model investment?