Sentence Compression as Deletion with Contextual Embeddings
Sentence compression is the task of creating a shorter version of an input sentence while keeping important information. In this paper, we extend the task of compression by deletion with the use of contextual embeddings. Different from prior work usually using non-contextual embeddings (Glove or Word2Vec), we exploit contextual embeddings that enable our model capturing the context of inputs. More precisely, we utilize contextual embeddings stacked by bidirectional Long-short Term Memory and Conditional Random Fields for dealing with sequence labeling. Experimental results on a benchmark Google dataset show that by utilizing contextual embeddings, our model achieves a new state-of-the-art F-score compared to strong methods reported on the leader board.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSentence CompressionSimilar Papers 제목 키워드 기반
A Language Model based Evaluator for Sentence Compression
We herein present a language-model-based evaluator for deletion-based sentence compression and view this task as a series of deletion-and-evaluation operations using the evaluator. More specifically, the evaluator is a s…
Language ModelingLanguage Modellingmodelreinforcement-learning+4Sentence Compression by Deletion with LSTMs
Deleter: Leveraging BERT to Perform Unsupervised Successive Text Compression
Text compression has diverse applications such as Summarization, Reading Comprehension and Text Editing. However, almost all existing approaches require either hand-crafted features, syntactic labels or parallel data. Ev…
Language ModellingReading ComprehensionSentenceSentence Compression+1Learning-Based Single-Document Summarization with Compression and Anaphoricity Constraints
We present a discriminative model for single-document summarization that integrally combines compression and anaphoricity constraints. Our model selects textual units to include in the summary based on a rich set of spar…
Document SummarizationSentenceA Simple Yet Effective Corpus Construction Method for Chinese Sentence Compression
Deletion-based sentence compression in the English language has made significant progress over the past few decades. However, there is a lack of large-scale and high-quality parallel corpus (i.e., (sentence, compression)…
SentenceSentence Compression