Workflow-Guided Response Generation for Task-Oriented Dialogue
Task-oriented dialogue (TOD) systems aim to achieve specific goals through interactive dialogue. Such tasks usually involve following specific workflows, i.e. executing a sequence of actions in a particular order. While prior work has focused on supervised learning methods to condition on past actions, they do not explicitly optimize for compliance to a desired workflow. In this paper, we propose a novel framework based on reinforcement learning (RL) to generate dialogue responses that are aligned with a given workflow. Our framework consists of ComplianceScorer, a metric designed to evaluate how well a generated response executes the specified action, combined with an RL opimization process that utilizes an interactive sampling technique. We evaluate our approach on two TOD datasets, Action-Based Conversations Dataset (ABCD) (Chen et al., 2021a) and MultiWOZ 2.2 (Zang et al., 2020) on a range of automated and human evaluation metrics. Our findings indicate that our RL-based framework outperforms baselines and is effective at enerating responses that both comply with the intended workflows while being expressed in a natural and fluent manner.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement Learning (RL)Response GenerationSimilar Papers 제목 키워드 기반
BoilerBot: A reliable task-oriented chatbot enhanced with large language models
This paper outlines the design and deployment of BoilerBot: a task-oriented multi- modal conversational agent developed for the Alexa Prize TaskBot 2 competition. BoilerBot features flexible response generation, leveragi…
ChatbotResponse GenerationG4: Grounding-guided Goal-oriented Dialogues Generation with Multiple Documents
Goal-oriented dialogues generation grounded in multiple documents(MultiDoc2Dial) is a challenging and realistic task. Unlike previous works which treat document-grounded dialogue modeling as a machine reading comprehensi…
Machine Reading ComprehensionReading ComprehensionResponse GenerationMultiDM-GCN: Aspect-guided Response Generation in Multi-domain Multi-modal Dialogue System using Graph Convolutional Network
In the recent past, dialogue systems have gained immense popularity and have become ubiquitous. During conversations, humans not only rely on languages but seek contextual information through visual contents as well. In …
DecoderResponse GenerationSchema-Guided Semantic Accuracy: Faithfulness in Task-Oriented Dialogue Response Generation
Ensuring that generated utterances are faithful to dialogue actions is crucial for Task-Oriented Dialogue Response Generation. Slot Error Rate (SER) only partially measures generation quality in that it solely assesses u…
Natural Language InferenceResponse GenerationUsing Medical Algorithms for Task-Oriented Dialogue in LLM-Based Medical Interviews
We developed a task-oriented dialogue framework structured as a Directed Acyclic Graph (DAG) of medical questions. The system integrates: (1) a systematic pipeline for transforming medical algorithms and guidelines into …