Unsupervised Abstractive Sentence Summarization using Length Controlled Variational Autoencoder
In this work we present an unsupervised approach to summarize sentences in abstractive way using Variational Autoencoder (VAE). VAE are known to learn a semantically rich latent variable, representing high dimensional input. VAEs are trained by learning to reconstruct the input from the probabilistic latent variable. Explicitly providing the information about output length during training influences the VAE to not encode this information and thus can be manipulated during inference. Instructing the decoder to produce a shorter output sequence leads to expressing the input sentence with fewer words. We show on different summarization data sets, that these shorter sentences can not beat a simple baseline but yield higher ROUGE scores than trying to reconstruct the whole sentence.
Code (1)
Tasks
DecoderSentenceSentence SummarizationUnsupervised Sentence SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization
Sentence summarization shortens given texts while maintaining core contents of the texts. Unsupervised approaches have been studied to summarize texts without human-written summaries. However, recent unsupervised models …
Abstractive Text Summarizationreinforcement-learningReinforcement Learning (RL)Sentence+2Abstractive Unsupervised Multi-Document Summarization using Paraphrastic Sentence Fusion
In this work, we aim at developing an unsupervised abstractive summarization system in the multi-document setting. We design a paraphrastic sentence fusion model which jointly performs sentence fusion and paraphrasing us…
Abstractive Text SummarizationDocument SummarizationMachine TranslationMulti-Document Summarization+5The Rule of Three: Abstractive Text Summarization in Three Bullet Points
Neural network-based approaches have become widespread for abstractive text summarization. Though previously proposed models for abstractive text summarization addressed the problem of repetition of the same contents in …
Abstractive Text SummarizationSentenceText SummarizationUnsupervised document summarization using pre-trained sentence embeddings and graph centrality
This paper describes our submission for the LongSumm task in SDP 2021. We propose a method for incorporating sentence embeddings produced by deep language models into extractive summarization techniques based on graph ce…
Abstractive Text SummarizationDocument SummarizationExtractive SummarizationSentence+1Length-controllable Abstractive Summarization by Guiding with Summary Prototype
We propose a new length-controllable abstractive summarization model. Recent state-of-the-art abstractive summarization models based on encoder-decoder models generate only one summary per source text. However, controlla…
Abstractive Text SummarizationDecoder