A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems

Paper · arXiv 2402.18013 · Published February 28, 2024
Dialog Topics and Modeling

This survey provides a comprehensive review of research on multi-turn dialogue systems, with a particular focus on multi-turn dialogue systems based on large language models (LLMs). This paper aims to (a) give a summary of existing LLMs and approaches for adapting LLMs to downstream tasks; (b) elaborate recent advances in multi-turn dialogue systems, covering both LLM-based open-domain dialogue (ODD) and task-oriented dialogue (TOD) systems, along with datasets and evaluation metrics; (c) discuss some future emphasis and recent research problems arising from the development of LLMs and the increasing demands on multi-turn dialogue systems.

Introduction. Multi-turn dialogue systems that can generate natural and meaningful responses to communicate with humans are a Multi-turn dialogue systems can be divided into TOD systems and ODD systems. TOD systems assist users in Conventional dialogue systems primarily rely on rule-based approaches and retrieval-based methods. Rule-based enhanced by the emergence of pre-trained LLMs.

Discussion / Conclusion. 10 CONCLUSION evaluation metrics derived from the outputs of multi-turn dialogue systems, which aid in assessing and understanding

Lines of inquiry this paper opens 24

Research framings built by reading the notes related to this paper — the questions it feeds into.

What determines AI's persuasive power and how can it be detected or mitigated? Does disclosing AI authorship change how audiences evaluate the writing? What enables conversational agents to guide rather than just respond? Can AI systems participate in genuine communication or only simulate it? What structural patterns sustain successful multi-turn dialogue and prevent breakdown? Do language models reason through disagreement or only accommodate it? Can LLMs distinguish between linguistic form and semantic meaning? Is embodied interaction necessary for language meaning and agency? What distinguishes genuine communicative competence from surface language performance? How do curriculum design and feedback approaches affect model learning? Can language models reason beyond surface pattern matching? Can real-time working alliance measurement improve therapy outcomes?