paper-with-me

Papers

Enhancing Coherence of Extractive Summarization with Multitask Learning

2023-05-22 · Renlong Jie, Xiaojun Meng, Lifeng Shang, Xin Jiang, Qun Liu

This study proposes a multitask learning architecture for extractive summarization with coherence boosting. The architecture contains an extractive summarizer and coherent discriminator module. The coherent discriminator is trained online on the sentence vectors of the augmented textual input, thus improving its general ability of judging whether the input sentences are coherent. Meanwhile, we maximize the coherent scores from the coherent discriminator by updating the parameters of the summarizer. To make the extractive sentences trainable in a differentiable manner, we introduce two strategies, including pre-trained converting model (model-based) and converting matrix (MAT-based) that merge sentence representations. Experiments show that our proposed method significantly improves the proportion of consecutive sentences in the extracted summaries based on their positions in the original article (i.e., automatic sentence-level coherence metric), while the goodness in terms of other automatic metrics (i.e., Rouge scores and BertScores) are preserved. Human evaluation also evidences the improvement of coherence and consistency of the extracted summaries given by our method.

📄 PDF Abstract BibTeX arXiv:2305.12851

Code (0)

등록된 구현이 없습니다.

Tasks

Extractive SummarizationSentence

Similar Papers 제목 키워드 기반

Exploring Multitask Learning for Low-Resource AbstractiveSummarization

2021-09-17 · Ahmed Magooda, Mohamed Elaraby, Diane Litman

This paper explores the effect of using multitask learning for abstractive summarization in the context of small training corpora. In particular, we incorporate four different tasks (extractive summarization, language mo…

Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling

Exploring Multitask Learning for Low-Resource Abstractive Summarization

2021-11-01 · Findings (EMNLP) 2021 11 · Ahmed Magooda, Diane Litman, Mohamed Elaraby

This paper explores the effect of using multitask learning for abstractive summarization in the context of small training corpora. In particular, we incorporate four different tasks (extractive summarization, language mo…

Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling

Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMs

2024-07-05 · Mihir Parmar, Hanieh Deilamsalehy, Franck Dernoncourt, Seunghyun Yoon 외

Extractive summarization plays a pivotal role in natural language processing due to its wide-range applications in summarizing diverse content efficiently, while also being faithful to the original content. Despite signi…

Extractive Summarization

Topical Coherence for Graph-based Extractive Summarization

2015-09-01 · EMNLP 2015 9 · Daraksha Parveen, Hans-Martin Ramsl, Michael Strube
Document SummarizationExtractive Summarization

Learning to Extract Coherent Summary via Deep Reinforcement Learning

2018-04-19 · Yuxiang Wu, Baotian Hu

Coherence plays a critical role in producing a high-quality summary from a document. In recent years, neural extractive summarization is becoming increasingly attractive. However, most of them ignore the coherence of sum…

Deep Reinforcement LearningExtractive SummarizationFeature Engineeringreinforcement-learning+4