Simple Conversational Data Augmentation for Semi-supervised Abstractive Dialogue Summarization
Abstractive conversation summarization has received growing attention while most current state-of-the-art summarization models heavily rely on human-annotated summaries. To reduce the dependence on labeled summaries, in this work, we present a simple yet effective set of Conversational Data Augmentation (CODA) methods for semi-supervised abstractive conversation summarization, such as random swapping/deletion to perturb the discourse relations inside conversations, dialogue-acts-guided insertion to interrupt the development of conversations, and conditional-generation-based substitution to substitute utterances with their paraphrases generated based on the conversation context. To further utilize unlabeled conversations, we combine CODA with two-stage noisy self-training where we first pre-train the summarization model on unlabeled conversations with pseudo summaries and then fine-tune it on labeled conversations. Experiments conducted on the recent conversation summarization datasets demonstrate the effectiveness of our methods over several state-of-the-art data augmentation baselines.
Code (1)
Tasks
Abstractive Dialogue SummarizationConversation SummarizationData AugmentationSimilar Papers 제목 키워드 기반
Improving Dialogue Breakdown Detection with Semi-Supervised Learning
Building user trust in dialogue agents requires smooth and consistent dialogue exchanges. However, agents can easily lose conversational context and generate irrelevant utterances. These situations are called dialogue br…
Data AugmentationA Simple Baseline for Semi-supervised Semantic Segmentation with Strong Data Augmentation
Recently, significant progress has been made on semantic segmentation. However, the success of supervised semantic segmentation typically relies on a large amount of labelled data, which is time-consuming and costly to o…
Data Augmentationimage-classificationImage ClassificationPseudo Label+3Dense FixMatch: a simple semi-supervised learning method for pixel-wise prediction tasks
We propose Dense FixMatch, a simple method for online semi-supervised learning of dense and structured prediction tasks combining pseudo-labeling and consistency regularization via strong data augmentation. We enable the…
Data Augmentationimage-classificationSemantic SegmentationSemi-Supervised Semantic SegmentationAugmentation Matters: A Simple-yet-Effective Approach to Semi-supervised Semantic Segmentation
Recent studies on semi-supervised semantic segmentation (SSS) have seen fast progress. Despite their promising performance, current state-of-the-art methods tend to increasingly complex designs at the cost of introducing…
Semantic SegmentationSemi-Supervised Semantic SegmentationTied-Augment: Controlling Representation Similarity Improves Data Augmentation
Data augmentation methods have played an important role in the recent advance of deep learning models, and have become an indispensable component of state-of-the-art models in semi-supervised, self-supervised, and superv…
Data Augmentation