paper-with-me

Papers

InstructTODS: Large Language Models for End-to-End Task-Oriented Dialogue Systems

2023-10-13 · Willy Chung, Samuel Cahyawijaya, Bryan Wilie, Holy Lovenia, Pascale Fung

Large language models (LLMs) have been used for diverse tasks in natural language processing (NLP), yet remain under-explored for task-oriented dialogue systems (TODS), especially for end-to-end TODS. We present InstructTODS, a novel off-the-shelf framework for zero-shot end-to-end task-oriented dialogue systems that can adapt to diverse domains without fine-tuning. By leveraging LLMs, InstructTODS generates a proxy belief state that seamlessly translates user intentions into dynamic queries for efficient interaction with any KB. Our extensive experiments demonstrate that InstructTODS achieves comparable performance to fully fine-tuned TODS in guiding dialogues to successful completion without prior knowledge or task-specific data. Furthermore, a rigorous human evaluation of end-to-end TODS shows that InstructTODS produces dialogue responses that notably outperform both the gold responses and the state-of-the-art TODS in terms of helpfulness, informativeness, and humanness. Moreover, the effectiveness of LLMs in TODS is further supported by our comprehensive evaluations on TODS subtasks: dialogue state tracking, intent classification, and response generation. Code and implementations could be found here https://github.com/WillyHC22/InstructTODS/

📄 PDF Abstract BibTeX arXiv:2310.08885

Code (1)

willyhc22/instructtods 공식 구현 pytorch

Tasks

Dialogue State TrackingInformativenessintent-classificationIntent ClassificationResponse GenerationTask-Oriented Dialogue Systems

Similar Papers 제목 키워드 기반

JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset

2024-03-26 · Atsumoto Ohashi, Ryu Hirai, Shinya Iizuka, Ryuichiro Higashinaka

Dialogue datasets are crucial for deep learning-based task-oriented dialogue system research. While numerous English language multi-domain task-oriented dialogue datasets have been developed and contributed to significan…

Dialogue State TrackingLanguage ModelingLanguage ModellingLarge Language Model+2

DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue

2020-09-28 · Shikib Mehri, Mihail Eric, Dilek Hakkani-Tur

A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Eva…

Domain AdaptationMulti-domain Dialogue State TrackingNatural Language Understanding

TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue

2020-04-15 · EMNLP 2020 11 · Chien-Sheng Wu, Steven Hoi, Richard Socher, Caiming Xiong

The underlying difference of linguistic patterns between general text and task-oriented dialogue makes existing pre-trained language models less useful in practice. In this work, we unify nine human-human and multi-turn …

Dialogue State TrackingIntent DetectionLanguage ModelingLanguage Modelling+2

OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue

2022-09-10 · Zhi Chen, Yuncong Liu, Lu Chen, Su Zhu 외

This paper presents an ontology-aware pretrained language model (OPAL) for end-to-end task-oriented dialogue (TOD). Unlike chit-chat dialogue models, task-oriented dialogue models fulfill at least two task-specific modul…

Language ModelingLanguage ModellingText Generation

Application of frozen large-scale models to multimodal task-oriented dialogue

2023-10-02 · Tatsuki Kawamoto, Takuma Suzuki, Ko Miyama, Takumi Meguro 외

In this study, we use the existing Large Language Models ENnhanced to See Framework (LENS Framework) to test the feasibility of multimodal task-oriented dialogues. The LENS Framework has been proposed as a method to solv…