paper-with-me

Papers

Source Identification in Abstractive Summarization

2024-02-07 · Yoshi Suhara, Dimitris Alikaniotis

Neural abstractive summarization models make summaries in an end-to-end manner, and little is known about how the source information is actually converted into summaries. In this paper, we define input sentences that contain essential information in the generated summary as $\textit{source sentences}$ and study how abstractive summaries are made by analyzing the source sentences. To this end, we annotate source sentences for reference summaries and system summaries generated by PEGASUS on document-summary pairs sampled from the CNN/DailyMail and XSum datasets. We also formulate automatic source sentence detection and compare multiple methods to establish a strong baseline for the task. Experimental results show that the perplexity-based method performs well in highly abstractive settings, while similarity-based methods perform robustly in relatively extractive settings. Our code and data are available at https://github.com/suhara/sourcesum.

📄 PDF Abstract BibTeX arXiv:2402.04677

Code (1)

suhara/sourcesum 공식 구현 pytorch

Tasks

Abstractive Text SummarizationSentence

Methods 이 논문이 사용한 방법론

PEGASUS PEGASUS proposes a transformer-based model for abstractive summarization. It uses a special self-supervised pre-training objective called gap-sentences generation (GSG) that's…

Similar Papers 제목 키워드 기반

MNLP at MEDIQA 2021: Fine-Tuning PEGASUS for Consumer Health Question Summarization

2021-06-01 · NAACL (BioNLP) 2021 6 · Jooyeon Lee, Huong Dang, Ozlem Uzuner, Sam Henry

This paper details a Consumer Health Question (CHQ) summarization model submitted to MEDIQA 2021 for shared task 1: Question Summarization. Many CHQs are composed of multiple sentences with typos or unnecessary informati…

Abstractive Text SummarizationQuestion Answering

Neural Abstractive Text Summarizer for Telugu Language

2021-01-18 · Mohan Bharath B, Aravindh Gowtham B, Akhil M

Abstractive Text Summarization is the process of constructing semantically relevant shorter sentences which captures the essence of the overall meaning of the source text. It is actually difficult and very time consuming…

Abstractive Text SummarizationDecoderDeep LearningSentence+1

Unsupervised Abstractive Summarization of Bengali Text Documents

2021-01-26 · EACL 2021 2 · Radia Rayan Chowdhury, Mir Tafseer Nayeem, Tahsin Tasnim Mim, Md. Saifur Rahman Chowdhury 외

Abstractive summarization systems generally rely on large collections of document-summary pairs. However, the performance of abstractive systems remains a challenge due to the unavailability of parallel data for low-reso…

Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling+2

Exploring Multitask Learning for Low-Resource AbstractiveSummarization

2021-09-17 · Ahmed Magooda, Mohamed Elaraby, Diane Litman

This paper explores the effect of using multitask learning for abstractive summarization in the context of small training corpora. In particular, we incorporate four different tasks (extractive summarization, language mo…

Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling

Exploring Multitask Learning for Low-Resource Abstractive Summarization

2021-11-01 · Findings (EMNLP) 2021 11 · Ahmed Magooda, Diane Litman, Mohamed Elaraby

This paper explores the effect of using multitask learning for abstractive summarization in the context of small training corpora. In particular, we incorporate four different tasks (extractive summarization, language mo…

Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling