paper-with-me

홈 › Papers

Neural Abstractive Unsupervised Summarization of Online News Discussions

2021-06-07 · Ignacio Tampe Palma, Marcelo Mendoza, Evangelos Milios

Summarization has usually relied on gold standard summaries to train extractive or abstractive models. Social media brings a hurdle to summarization techniques since it requires addressing a multi-document multi-author approach. We address this challenging task by introducing a novel method that generates abstractive summaries of online news discussions. Our method extends a BERT-based architecture, including an attention encoding that fed comments' likes during the training stage. To train our model, we define a task which consists of reconstructing high impact comments based on popularity (likes). Accordingly, our model learns to summarize online discussions based on their most relevant comments. Our novel approach provides a summary that represents the most relevant aspects of a news item that users comment on, incorporating the social context as a source of information to summarize texts in online social networks. Our model is evaluated using ROUGE scores between the generated summary and each comment on the thread. Our model, including the social attention encoding, significantly outperforms both extractive and abstractive summarization methods based on such evaluation.

📄 PDF Abstract BibTeX arXiv:2106.03953

Code (1)

nachotp/BertCommentSum 공식 구현 pytorch

Tasks

Abstractive Text SummarizationUnsupervised Text Summarization

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
WordPiece 설명 없음
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Mining

2021-06-01 · ACL 2021 5 · Alexander R. Fabbri, Faiaz Rahman, Imad Rizvi, Borui Wang 외

While online conversations can cover a vast amount of information in many different formats, abstractive text summarization has primarily focused on modeling solely news articles. This research gap is due, in part, to th…

Abstractive Text SummarizationArgument MiningArticlesCommunity Question Answering+4

An Unsupervised Masking Objective for Abstractive Multi-Document News Summarization

2022-01-07 · Nikolai Vogler, Songlin Li, Yujie Xu, Yujian Mi 외

We show that a simple unsupervised masking objective can approach near supervised performance on abstractive multi-document news summarization. Our method trains a state-of-the-art neural summarization model to predict t…

Extractive SummarizationNews Summarization

OpineSum: Entailment-based self-training for abstractive opinion summarization

2022-12-21 · Annie Louis, Joshua Maynez

A typical product or place often has hundreds of reviews, and summarization of these texts is an important and challenging problem. Recent progress on abstractive summarization in domains such as news has been driven by …

Abstractive Text SummarizationArticlesFew-Shot LearningNatural Language Inference+1

The Bull and the Bear: Summarizing Stock Market Discussions

2022-06-01 · LREC 2022 6 · Ayush Kumar, Dhyey Jani, Jay Shah, Devanshu Thakar 외

Stock market investors debate and heavily discuss stock ideas, investing strategies, news and market movements on social media platforms. The discussions are significantly longer in length and require extensive domain ex…

Abstractive Text Summarization

TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising

2020-01-03 · Findings of the Association for Computational Linguistics 2020 · Ziyi Yang, Chenguang Zhu, Robert Gmyr, Michael Zeng 외

Text summarization aims to extract essential information from a piece of text and transform the text into a concise version. Existing unsupervised abstractive summarization models leverage recurrent neural networks frame…

Abstractive Text SummarizationArticlesDenoisingText Summarization