paper-with-me

Papers

A Unified and Efficient Contrastive Learning Framework for Text Summarization

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Both extractive and abstractive summarization systems share a common problem, i.e., there is a mismatch between the training object and evaluation metrics. To bridge this gap, we introduce a unified and efficient contrastive learning framework called UniCLS for both extractive and abstractive methods. In this framework, the summarization model not only learns how to write summaries but also is required to evaluate the generated summary. Without any additional parameters, our contrastive learning approach can be effortlessly applied to any extractive and abstractive summarization systems. Extensive experiments show that our framework brings substantial improvements on a wide range of datasets and clearly outperforms previous state-of-the-art end-to-end systems by a large margin on CNN/DailyMail benchmark. In Particular, UniCLS achieves an improvement of 1.75 ROUGE-1 score over the BART-large model without sacrificing inference efficiency.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Abstractive Text SummarizationContrastive LearningText Summarization

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Discourse-Aware Scientific Paper Recommendation via QA-Style Summarization and Multi-Level Contrastive Learning

2025-11-05 · Shenghua Wang, Zhen Yin arxiv

The rapid growth of open-access (OA) publications has intensified the challenge of identifying relevant scientific papers. Due to privacy constraints and limited access to user interaction data, recent efforts have shift…

Information RetrievalContrastive Learning

Align and Attend: Multimodal Summarization with Dual Contrastive Losses

2023-03-13 · CVPR 2023 1 · Bo He, Jun Wang, JieLin Qiu, Trung Bui 외

The goal of multimodal summarization is to extract the most important information from different modalities to form output summaries. Unlike the unimodal summarization, the multimodal summarization task explicitly levera…

Extractive Text SummarizationSupervised Video SummarizationVideo Summarization

CoNT: Contrastive Neural Text Generation

2022-05-29 · Chenxin An, Jiangtao Feng, Kai Lv, Lingpeng Kong 외

Recently, contrastive learning attracts increasing interests in neural text generation as a new solution to alleviate the exposure bias problem. It introduces a sequence-level training signal which is crucial to generati…

Code Comment GenerationComment GenerationContrastive LearningData-to-Text Generation+3

Constructing Contrastive samples via Summarization for Text Classification with limited annotations

2021-04-11 · Findings (EMNLP) 2021 11 · Yangkai Du, Tengfei Ma, Lingfei Wu, Fangli Xu 외

Contrastive Learning has emerged as a powerful representation learning method and facilitates various downstream tasks especially when supervised data is limited. How to construct efficient contrastive samples through da…

Contrastive LearningData AugmentationGeneral ClassificationRepresentation Learning+3

A Topic-aware Summarization Framework with Different Modal Side Information

2023-05-19 · Xiuying Chen, Mingzhe Li, Shen Gao, Xin Cheng 외

Automatic summarization plays an important role in the exponential document growth on the Web. On content websites such as CNN.com and WikiHow.com, there often exist various kinds of side information along with the main …

Contrastive LearningTriplet