Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training
The natural language generation (NLG) module in a task-oriented dialogue system produces user-facing utterances conveying required information. Thus, it is critical for the generated response to be natural and fluent. We propose to integrate adversarial training to produce more human-like responses. The model uses Straight-Through Gumbel-Softmax estimator for gradient computation. We also propose a two-stage training scheme to boost performance. Empirical results show that the adversarial training can effectively improve the quality of language generation in both automatic and human evaluations. For example, in the RNN-LG Restaurant dataset, our model AdvNLG outperforms the previous state-of-the-art result by 3.6% in BLEU.
Code (0)
등록된 구현이 없습니다.
Tasks
Text GenerationSimilar Papers 제목 키워드 기반
Naturalness Evaluation of Natural Language Generation in Task-oriented Dialogues using BERT
This paper presents an automatic method to evaluate the naturalness of natural language generation in dialogue systems. While this task was previously rendered through expensive and time-consuming human labor, we present…
InformativenessText GenerationTransfer LearningSalesBot 2.0: A Human-Like Intent-Guided Chit-Chat Dataset
In recent research on dialogue systems and corpora, there has been a significant focus on two distinct categories: task-oriented (TOD) and open-domain (chit-chat) dialogues. TOD systems aim to satisfy specific user goals…
Injecting Salesperson's Dialogue Strategies in Large Language Models with Chain-of-Thought Reasoning
Recent research in dialogue systems and corpora has focused on two main categories: task-oriented (TOD) and open-domain (chit-chat) dialogues. TOD systems help users accomplish specific tasks, while open-domain systems a…
Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue
In task-oriented dialogues, Natural Language Generation (NLG) is the final yet crucial step to produce user-facing system utterances. The result of NLG is directly related to the perceived quality and usability of a dial…
Language ModelingLanguage ModellingMulti-Task LearningText GenerationAct-Aware Slot-Value Predicting in Multi-Domain Dialogue State Tracking
As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogu…
Dialogue State TrackingMachine Reading ComprehensionMulti-domain Dialogue State TrackingReading Comprehension+1