InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems
Large language models (LLMs) have been used for diverse tasks in natural language processing (NLP), yet remain under-explored for task-oriented dialogue systems (TODS), especially for end-to-end TODS. We present InstructTODS, a novel off-the-shelf framework for zero-shot end-to-end task-oriented dialogue systems that can adapt to diverse domains without fine-tuning. By leveraging LLMs, InstructTODS generates a proxy belief state that seamlessly translates user intentions into dynamic queries for efficient interaction with any KB. Our extensive experiments demonstrate that InstructTODS achieves comparable performance to fully fine-tuned TODS in guiding dialogues to successful completion without prior knowledge or task-specific data. Furthermore, a rigorous human evaluation of end-to-end TODS shows that InstructTODS produces dialogue responses that notably outperform both the gold responses and the state-of-the-art TODS in terms of helpfulness, informativeness, and humanness. Moreover, the effectiveness of LLMs in TODS is further supported by our comprehensive evaluations on TODS subtasks: dialogue state tracking, intent classification, and response generation. Code and implementations could be found here https://github.com/WillyHC22/InstructTODS/
Code (1)
Tasks
Dialogue State TrackingInformativenessintent-classificationIntent ClassificationResponse GenerationTask-Oriented Dialogue SystemsSimilar Papers 제목 키워드 기반
JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset
Dialogue datasets are crucial for deep learning-based task-oriented dialogue system research. While numerous English language multi-domain task-oriented dialogue datasets have been developed and contributed to significan…
Dialogue State TrackingLanguage ModelingLanguage ModellingLarge Language Model+2DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue
A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Eva…
Domain AdaptationMulti-domain Dialogue State TrackingNatural Language UnderstandingTOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue
The underlying difference of linguistic patterns between general text and task-oriented dialogue makes existing pre-trained language models less useful in practice. In this work, we unify nine human-human and multi-turn …
Dialogue State TrackingIntent DetectionLanguage ModelingLanguage Modelling+2OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue
This paper presents an ontology-aware pretrained language model (OPAL) for end-to-end task-oriented dialogue (TOD). Unlike chit-chat dialogue models, task-oriented dialogue models fulfill at least two task-specific modul…
Language ModelingLanguage ModellingText GenerationApplication of frozen large-scale models to multimodal task-oriented dialogue
In this study, we use the existing Large Language Models ENnhanced to See Framework (LENS Framework) to test the feasibility of multimodal task-oriented dialogues. The LENS Framework has been proposed as a method to solv…