paper-with-me

홈 › Papers

A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation

2020-10-21 · NAACL 2021 4 · Yan Zeng, Jian-Yun Nie

Conditioned dialogue generation suffers from the scarcity of labeled responses. In this work, we exploit labeled non-dialogue text data related to the condition, which are much easier to collect. We propose a multi-task learning approach to leverage both labeled dialogue and text data. The 3 tasks jointly optimize the same pre-trained Transformer -- conditioned dialogue generation task on the labeled dialogue data, conditioned language encoding task and conditioned language generation task on the labeled text data. Experimental results show that our approach outperforms the state-of-the-art models by leveraging the labeled texts, and it also obtains larger improvement in performance comparing to the previous methods to leverage text data.

📄 PDF Abstract BibTeX arXiv:2010.11140

Code (1)

zengyan-97/MultiT-C-Dialog pytorch

Tasks

Dialogue GenerationLanguage ModellingMulti-Task LearningText Generation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Transformer A Transformer is a model architecture that eschews recurrence and instead relies entirely on an [attention…
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Pretrained Language Models for Dialogue Generation with Multiple Input Sources

2020-10-15 · Findings of the Association for Computational Linguistics 2020 · Yu Cao, Wei Bi, Meng Fang, DaCheng Tao

Large-scale pretrained language models have achieved outstanding performance on natural language understanding tasks. However, it is still under investigating how to apply them to dialogue generation tasks, especially th…

Dialogue GenerationLanguage ModelingLanguage ModellingNatural Language Understanding

CoLV: A Collaborative Latent Variable Model for Knowledge-Grounded Dialogue Generation

2021-11-01 · EMNLP 2021 11 · Haolan Zhan, Lei Shen, Hongshen Chen, Hainan Zhang

Knowledge-grounded dialogue generation has achieved promising performance with the engagement of external knowledge sources. Typical approaches towards this task usually perform relatively independent two sub-tasks, i.e.…

Dialogue GenerationDiversityResponse Generation

KG-CRuSE: Recurrent Walks over Knowledge Graph for Explainable Conversation Reasoning using Semantic Embeddings

2022-05-01 · NLP4ConvAI (ACL) 2022 5 · Rajdeep Sarkar, Mihael Arcan, John McCrae

Knowledge-grounded dialogue systems utilise external knowledge such as knowledge graphs to generate informative and appropriate responses. A crucial challenge of such systems is to select facts from a knowledge graph per…

DecoderFact SelectionKnowledge GraphsResponse Generation

Controlled Cue Generation for Play Scripts

2021-12-13 · Alara Dirik, Hilal Donmez, Pinar Yanardag

In this paper, we use a large-scale play scripts dataset to propose the novel task of theatrical cue generation from dialogues. Using over one million lines of dialogue and cues, we approach the problem of cue generation…

AttributeLanguage ModelingLanguage ModellingText Generation

Retrieve & Memorize: Dialog Policy Learning with Multi-Action Memory

2021-06-04 · Findings (ACL) 2021 8 · Yunhao Li, Yunyi Yang, Xiaojun Quan, Jianxing Yu

Dialogue policy learning, a subtask that determines the content of system response generation and then the degree of task completion, is essential for task-oriented dialogue systems. However, the unbalanced distribution …

DecoderResponse GenerationRetrievalTask-Oriented Dialogue Systems