paper-with-me

Papers

Contextualized Rewriting for Text Summarization

2021-01-31 · Guangsheng Bao, Yue Zhang

Extractive summarization suffers from irrelevance, redundancy and incoherence. Existing work shows that abstractive rewriting for extractive summaries can improve the conciseness and readability. These rewriting systems consider extracted summaries as the only input, which is relatively focused but can lose important background knowledge. In this paper, we investigate contextualized rewriting, which ingests the entire original document. We formalize contextualized rewriting as a seq2seq problem with group alignments, introducing group tag as a solution to model the alignments, identifying extracted summaries through content-based addressing. Results show that our approach significantly outperforms non-contextualized rewriting systems without requiring reinforcement learning, achieving strong improvements on ROUGE scores upon multiple extractive summarizers.

📄 PDF Abstract BibTeX arXiv:2102.00385

Code (2)

baoguangsheng/ctx-rewriter-for-summ 공식 구현 pytorch
baoguangsheng/g-transformer pytorch

Tasks

Extractive Summarizationreinforcement-learningReinforcement Learning (RL)TAGText Summarization

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

A General Contextualized Rewriting Framework for Text Summarization

2022-07-13 · Guangsheng Bao, Yue Zhang

The rewriting method for text summarization combines extractive and abstractive approaches, improving the conciseness and readability of extractive summaries using an abstractive model. Exiting rewriting systems take eac…

reinforcement-learningReinforcement Learning (RL)SentenceTAG+1

Controllable Decontextualization of Yes/No Question and Answers into Factual Statements

2024-01-18 · Lingbo Mo, Besnik Fetahu, Oleg Rokhlenko, Shervin Malmasi

Yes/No or polar questions represent one of the main linguistic question categories. They consist of a main interrogative clause, for which the answer is binary (assertion or negation). Polar questions and answers (PQA) r…

Negation

Clustering of Deep Contextualized Representations for Summarization of Biomedical Texts

2019-08-06 · Milad Moradi, Matthias Samwald

In recent years, summarizers that incorporate domain knowledge into the process of text summarization have outperformed generic methods, especially for summarization of biomedical texts. However, construction and mainten…

ClusteringLanguage ModelingLanguage ModellingText Summarization

Multi-Document Summarization with Determinantal Point Processes and Contextualized Representations

2019-10-24 · WS 2019 11 · Sangwoo Cho, Chen Li, Dong Yu, Hassan Foroosh 외

Emerged as one of the best performing techniques for extractive summarization, determinantal point processes select the most probable set of sentences to form a summary according to a probability measure defined by model…

Document SummarizationExtractive SummarizationMulti-Document SummarizationPoint Processes+1

From spoken dialogue to formal summary: An utterance rewriting for dialogue summarization

2022-07-01 · NAACL 2022 7 · Yue Fang, Hainan Zhang, Hongshen Chen, Zhuoye Ding 외

Due to the dialogue characteristics of unstructured contexts and multi-parties with first-person perspective, many successful text summarization works have failed when dealing with dialogue summarization. In dialogue sum…

Data Augmentationdialogue summaryText Summarization