A Unified and Efficient Contrastive Learning Framework for Text Summarization
Both extractive and abstractive summarization systems share a common problem, i.e., there is a mismatch between the training object and evaluation metrics. To bridge this gap, we introduce a unified and efficient contrastive learning framework called UniCLS for both extractive and abstractive methods. In this framework, the summarization model not only learns how to write summaries but also is required to evaluate the generated summary. Without any additional parameters, our contrastive learning approach can be effortlessly applied to any extractive and abstractive summarization systems. Extensive experiments show that our framework brings substantial improvements on a wide range of datasets and clearly outperforms previous state-of-the-art end-to-end systems by a large margin on CNN/DailyMail benchmark. In Particular, UniCLS achieves an improvement of 1.75 ROUGE-1 score over the BART-large model without sacrificing inference efficiency.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationContrastive LearningText SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Discourse-Aware Scientific Paper Recommendation via QA-Style Summarization and Multi-Level Contrastive Learning
The rapid growth of open-access (OA) publications has intensified the challenge of identifying relevant scientific papers. Due to privacy constraints and limited access to user interaction data, recent efforts have shift…
Information RetrievalContrastive LearningAlign and Attend: Multimodal Summarization with Dual Contrastive Losses
The goal of multimodal summarization is to extract the most important information from different modalities to form output summaries. Unlike the unimodal summarization, the multimodal summarization task explicitly levera…
Extractive Text SummarizationSupervised Video SummarizationVideo SummarizationCoNT: Contrastive Neural Text Generation
Recently, contrastive learning attracts increasing interests in neural text generation as a new solution to alleviate the exposure bias problem. It introduces a sequence-level training signal which is crucial to generati…
Code Comment GenerationComment GenerationContrastive LearningData-to-Text Generation+3Constructing Contrastive samples via Summarization for Text Classification with limited annotations
Contrastive Learning has emerged as a powerful representation learning method and facilitates various downstream tasks especially when supervised data is limited. How to construct efficient contrastive samples through da…
Contrastive LearningData AugmentationGeneral ClassificationRepresentation Learning+3A Topic-aware Summarization Framework with Different Modal Side Information
Automatic summarization plays an important role in the exponential document growth on the Web. On content websites such as CNN.com and WikiHow.com, there often exist various kinds of side information along with the main …
Contrastive LearningTriplet