Adaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement Learning
When a natural language generation (NLG) component is implemented in a real-world task-oriented dialogue system, it is necessary to generate not only natural utterances as learned on training data but also utterances adapted to the dialogue environment (e.g., noise from environmental sounds) and the user (e.g., users with low levels of understanding ability). Inspired by recent advances in reinforcement learning (RL) for language generation tasks, we propose ANTOR, a method for Adaptive Natural language generation for Task-Oriented dialogue via Reinforcement learning. In ANTOR, a natural language understanding (NLU) module, which corresponds to the user's understanding of system utterances, is incorporated into the objective function of RL. If the NLG's intentions are correctly conveyed to the NLU, which understands a system's utterances, the NLG is given a positive reward. We conducted experiments on the MultiWOZ dataset, and we confirmed that ANTOR could generate adaptive utterances against speech recognition errors and the different vocabulary levels of users.
Code (1)
Tasks
Natural Language Understandingreinforcement-learningReinforcement LearningReinforcement Learning (RL)speech-recognitionSpeech RecognitionText GenerationSimilar Papers 제목 키워드 기반
Continual Learning for Natural Language Generation in Task-oriented Dialog Systems
Natural language generation (NLG) is an essential component of task-oriented dialog systems. Despite the recent success of neural approaches for NLG, they are typically developed in an offline manner for particular domai…
Continual LearningText GenerationA Novel Task-Oriented Text Corpus in Silent Speech Recognition and its Natural Language Generation Construction Method
Millions of people with severe speech disorders around the world may regain their communication capabilities through techniques of silent speech recognition (SSR). Using electroencephalography (EEG) as a biomarker for sp…
Data-to-Text GenerationDiversityEEGElectroencephalogram (EEG)+4Few-shot Natural Language Generation for Task-Oriented Dialog
As a crucial component in task-oriented dialog systems, the Natural Language Generation (NLG) module converts a dialog act represented in a semantic form into a response in natural language. The success of traditional te…
Data-to-Text GenerationFew-Shot LearningText GenerationDialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue
A long-standing goal of task-oriented dialogue research is the ability to flexibly adapt dialogue models to new domains. To progress research in this direction, we introduce DialoGLUE (Dialogue Language Understanding Eva…
Domain AdaptationMulti-domain Dialogue State TrackingNatural Language UnderstandingMulti-task Learning for Natural Language Generation in Task-Oriented Dialogue
In task-oriented dialogues, Natural Language Generation (NLG) is the final yet crucial step to produce user-facing system utterances. The result of NLG is directly related to the perceived quality and usability of a dial…
Language ModelingLanguage ModellingMulti-Task LearningText Generation