A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation
Conditioned dialogue generation suffers from the scarcity of labeled responses. In this work, we exploit labeled non-dialogue text data related to the condition, which are much easier to collect. We propose a multi-task learning approach to leverage both labeled dialogue and text data. The 3 tasks jointly optimize the same pre-trained Transformer -- conditioned dialogue generation task on the labeled dialogue data, conditioned language encoding task and conditioned language generation task on the labeled text data. Experimental results show that our approach outperforms the state-of-the-art models by leveraging the labeled texts, and it also obtains larger improvement in performance comparing to the previous methods to leverage text data.
Code (1)
Tasks
Dialogue GenerationLanguage ModellingMulti-Task LearningText GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Pretrained Language Models for Dialogue Generation with Multiple Input Sources
Large-scale pretrained language models have achieved outstanding performance on natural language understanding tasks. However, it is still under investigating how to apply them to dialogue generation tasks, especially th…
Dialogue GenerationLanguage ModelingLanguage ModellingNatural Language UnderstandingCoLV: A Collaborative Latent Variable Model for Knowledge-Grounded Dialogue Generation
Knowledge-grounded dialogue generation has achieved promising performance with the engagement of external knowledge sources. Typical approaches towards this task usually perform relatively independent two sub-tasks, i.e.…
Dialogue GenerationDiversityResponse GenerationKG-CRuSE: Recurrent Walks over Knowledge Graph for Explainable Conversation Reasoning using Semantic Embeddings
Knowledge-grounded dialogue systems utilise external knowledge such as knowledge graphs to generate informative and appropriate responses. A crucial challenge of such systems is to select facts from a knowledge graph per…
DecoderFact SelectionKnowledge GraphsResponse GenerationControlled Cue Generation for Play Scripts
In this paper, we use a large-scale play scripts dataset to propose the novel task of theatrical cue generation from dialogues. Using over one million lines of dialogue and cues, we approach the problem of cue generation…
AttributeLanguage ModelingLanguage ModellingText GenerationRetrieve & Memorize: Dialog Policy Learning with Multi-Action Memory
Dialogue policy learning, a subtask that determines the content of system response generation and then the degree of task completion, is essential for task-oriented dialogue systems. However, the unbalanced distribution …
DecoderResponse GenerationRetrievalTask-Oriented Dialogue Systems