Abstractive Summarization Using Attentive Neural Techniques
In a world of proliferating data, the ability to rapidly summarize text is growing in importance. Automatic summarization of text can be thought of as a sequence to sequence problem. Another area of natural language processing that solves a sequence to sequence problem is machine translation, which is rapidly evolving due to the development of attention-based encoder-decoder networks. This work applies these modern techniques to abstractive summarization. We perform analysis on various attention mechanisms for summarization with the goal of developing an approach and architecture aimed at improving the state of the art. In particular, we modify and optimize a translation model with self-attention for generating abstractive sentence summaries. The effectiveness of this base model along with attention variants is compared and analyzed in the context of standardized evaluation sets and test metrics. However, we show that these metrics are limited in their ability to effectively score abstractive summaries, and propose a new approach based on the intuition that an abstractive model requires an abstractive evaluation.
Code (2)
Tasks
Abstractive Text SummarizationDecoderMachine TranslationSentenceTranslationSimilar Papers 제목 키워드 기반
Abstractive Sentence Summarization with Attentive Recurrent Neural Networks
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents
Neural abstractive summarization models have led to promising results in summarizing relatively short documents. We propose the first model for abstractive summarization of single, longer-form documents (e.g., research p…
Abstractive Text SummarizationDecoderText SummarizationUnsupervised Extractive SummarizationDecoupling Encoder and Decoder Networks for Abstractive Document Summarization
Abstractive document summarization seeks to automatically generate a summary for a document, based on some abstract {``}understanding{''} of the original document. State-of-the-art techniques traditionally use attentive …
Abstractive Text SummarizationDecoderDocument SummarizationAbstractive Headline Generation for Spoken Content by Attentive Recurrent Neural Networks with ASR Error Modeling
Headline generation for spoken content is important since spoken content is difficult to be shown on the screen and browsed by the user. It is a special type of abstractive summarization, for which the summaries are gene…
Abstractive Text SummarizationDocument SummarizationHeadline GenerationA Self-Attentive Hierarchical Model for Jointly Improving Text Summarization and Sentiment Classification
Text summarization and sentiment classification, in NLP, are two main tasks implemented on text analysis, focusing on extracting the major idea of a text at different levels. Based on the characteristics of both, senti…
Abstractive Text SummarizationClassificationGeneral ClassificationSentiment Analysis+2