ExtraPhrase: Efficient Data Augmentation for Abstractive Summarization
Neural models trained with large amount of parallel data have achieved impressive performance in abstractive summarization tasks. However, large-scale parallel corpora are expensive and challenging to construct. In this work, we introduce a low-cost and effective strategy, ExtraPhrase, to augment training data for abstractive summarization tasks. ExtraPhrase constructs pseudo training data in two steps: extractive summarization and paraphrasing. We extract major parts of an input text in the extractive summarization step, and obtain its diverse expressions with the paraphrasing step. Through experiments, we show that ExtraPhrase improves the performance of abstractive summarization tasks by more than 0.50 points in ROUGE scores compared to the setting without data augmentation. ExtraPhrase also outperforms existing methods such as back-translation and self-training. We also show that ExtraPhrase is significantly effective when the amount of genuine training data is remarkably small, i.e., a low-resource setting. Moreover, ExtraPhrase is more cost-efficient than the existing approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationData AugmentationExtractive SummarizationSimilar Papers 제목 키워드 기반
Mitigating Data Scarceness through Data Synthesis, Augmentation and Curriculum for Abstractive Summarization
This paper explores three simple data manipulation techniques (synthesis, augmentation, curriculum) for improving abstractive summarization models without the need for any additional data. We introduce a method of data s…
Abstractive Text SummarizationData AugmentationSpecificitySimple Conversational Data Augmentation for Semi-supervised Abstractive Dialogue Summarization
Abstractive conversation summarization has received growing attention while most current state-of-the-art summarization models heavily rely on human-annotated summaries. To reduce the dependence on labeled summaries, in …
Abstractive Dialogue SummarizationConversation SummarizationData AugmentationAbstractive Summarization as Augmentation for Document-Level Event Detection
Transformer-based models have consistently produced substantial performance gains across a variety of NLP tasks, compared to shallow models. However, deep models are orders of magnitude more computationally expensive tha…
Abstractive Text SummarizationEvent DetectionText GenerationText SummarizationCounterfactual Data Augmentation improves Factuality of Abstractive Summarization
Abstractive summarization systems based on pretrained language models often generate coherent but factually inconsistent sentences. In this paper, we present a counterfactual data augmentation approach where we augment d…
Abstractive Text SummarizationcounterfactualData AugmentationDiversityExploring Cross-Lingual Guidance in Abstractive Summarization
Cross-lingual guidance (CLG) as an augmentation method is often applied in cross-lingual summarization (CLS) to improve its performance. In this paper, we empirically study how cross-lingual information of different qual…
Abstractive Text Summarization