Exploring Sentence Vectors Through Automatic Summarization
Vector semantics, especially sentence vectors, have recently been used successfully in many areas of natural language processing. However, relatively little work has explored the internal structure and properties of spaces of sentence vectors. In this paper, we will explore the properties of sentence vectors by studying a particular real-world application: Automatic Summarization. In particular, we show that cosine similarity between sentence vectors and document vectors is strongly correlated with sentence importance and that vector semantics can identify and correct gaps between the sentences chosen so far and the document. In addition, we identify specific dimensions which are linked to effective summaries. To our knowledge, this is the first time specific dimensions of sentence embeddings have been connected to sentence properties. We also compare the features of different methods of sentence embeddings. Many of these insights have applications in uses of sentence embeddings far beyond summarization.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSentence EmbeddingsSimilar Papers 제목 키워드 기반
Exploring Sentence Vector Spaces through Automatic Summarization
Given vector representations for individual words, it is necessary to compute vector representations of sentences for many applications in a compositional manner, often using artificial neural networks. Relatively litt…
SentenceSentence EmbeddingsExploring Content Selection in Summarization of Novel Chapters
We present a new summarization task, generating summaries of novel chapters using summary/chapter pairs from online study guides. This is a harder task than the news summarization task, given the chapter length as well a…
Extractive SummarizationNews SummarizationEnhancing Coherence of Extractive Summarization with Multitask Learning
This study proposes a multitask learning architecture for extractive summarization with coherence boosting. The architecture contains an extractive summarizer and coherent discriminator module. The coherent discriminator…
Extractive SummarizationSentenceExploring the limits of a base BART for multi-document summarization in the medical domain
This paper is a description of our participation in the Multi-document Summarization for Literature Review (MSLR) Shared Task, in which we explore summarization models to create an automatic review of scientific results.…
Document SummarizationMulti-Document SummarizationCascaded Attention based Unsupervised Information Distillation for Compressive Summarization
When people recall and digest what they have read for writing summaries, the important content is more likely to attract their attention. Inspired by this observation, we propose a cascaded attention based unsupervised m…
Document SummarizationMulti-Document SummarizationSentenceSentence Compression