Contextualized context2vec
Lexical substitution ranks substitution candidates from the viewpoint of paraphrasability for a target word in a given sentence. There are two major approaches for lexical substitution: (1) generating contextualized word embeddings by assigning multiple embeddings to one word and (2) generating context embeddings using the sentence. Herein we propose a method that combines these two approaches to contextualize word embeddings for lexical substitution. Experiments demonstrate that our method outperforms the current state-of-the-art method. We also create CEFR-LP, a new evaluation dataset for the lexical substitution task. It has a wider coverage of substitution candidates than previous datasets and assigns English proficiency levels to all target words and substitution candidates.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceWord EmbeddingsSimilar Papers 제목 키워드 기반
Contextualized Machine Learning
We examine Contextualized Machine Learning (ML), a paradigm for learning heterogeneous and context-dependent effects. Contextualized ML estimates heterogeneous functions by applying deep learning to the meta-relationship…
Contextualized Weak Supervision for Text Classification
Weakly supervised text classification based on a few user-provided seed words has recently attracted much attention from researchers. Existing methods mainly generate pseudo-labels in a context-free manner (e.g., string …
ClassificationGeneral Classificationtext-classificationText ClassificationGenerating Uncontextualized and Contextualized Questions for Document-Level Event Argument Extraction
This paper presents multiple question generation strategies for document-level event argument extraction. These strategies do not require human involvement and result in uncontextualized questions as well as contextualiz…
Event Argument ExtractionQuestion GenerationQuestion-GenerationKeyphrase Extraction from Scholarly Articles as Sequence Labeling using Contextualized Embeddings
In this paper, we formulate keyphrase extraction from scholarly articles as a sequence labeling task solved using a BiLSTM-CRF, where the words in the input text are represented using deep contextualized embeddings. We e…
ArticlesKeyphrase ExtractionWord EmbeddingsCombination of Contextualized and Non-Contextualized Layers for Lexical Substitution in French
Lexical substitution task requires to substitute a target word by candidates in a given context. Candidates must keep meaning and grammatically of the sentence. The task, introduced in the SemEval 2007, has two objective…
Language ModellingSentence