NeuralWOZ: Learning to Collect Task-Oriented Dialogue via Model-Based Simulation
We propose NeuralWOZ, a novel dialogue collection framework that uses model-based dialogue simulation. NeuralWOZ has two pipelined models, Collector and Labeler. Collector generates dialogues from (1) user's goal instructions, which are the user context and task constraints in natural language, and (2) system's API call results, which is a list of possible query responses for user requests from the given knowledge base. Labeler annotates the generated dialogue by formulating the annotation as a multiple-choice problem, in which the candidate labels are extracted from goal instructions and API call results. We demonstrate the effectiveness of the proposed method in the zero-shot domain transfer learning for dialogue state tracking. In the evaluation, the synthetic dialogue corpus generated from NeuralWOZ achieves a new state-of-the-art with improvements of 4.4% point joint goal accuracy on average across domains, and improvements of 5.7% point of zero-shot coverage against the MultiWOZ 2.1 dataset.
Code (1)
Tasks
Dialogue State TrackingMultiple-choiceTransfer LearningSimilar Papers 제목 키워드 기반
Personalizing a Dialogue System with Transfer Reinforcement Learning
It is difficult to train a personalized task-oriented dialogue system because the data collected from each individual is often insufficient. Personalized dialogue systems trained on a small dataset can overfit and make i…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Transfer Learning+1Towards Universal Dialogue Act Tagging for Task-Oriented Dialogues
Machine learning approaches for building task-oriented dialogue systems require large conversational datasets with labels to train on. We are interested in building task-oriented dialogue systems from human-human convers…
Task-Oriented Dialogue SystemsSimulating User Satisfaction for the Evaluation of Task-oriented Dialogue Systems
Evaluation is crucial in the development process of task-oriented dialogue systems. As an evaluation method, user simulation allows us to tackle issues such as scalability and cost-efficiency, making it a viable choice f…
Domain GeneralizationMovie RecommendationTask-Oriented Dialogue SystemsUser SimulationA User Simulator for Task-Completion Dialogues
Despite widespread interests in reinforcement-learning for task-oriented dialogue systems, several obstacles can frustrate research and development progress. First, reinforcement learners typically require interaction wi…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Task-Oriented Dialogue Systems+1MMWOZ: Building Multimodal Agent for Task-oriented Dialogue
Task-oriented dialogue systems have garnered significant attention due to their conversational ability to accomplish goals, such as booking airline tickets for users. Traditionally, task-oriented dialogue systems are con…
Task-Oriented Dialogue Systems