Verb Sense Clustering using Contextualized Word Representations for Semantic Frame Induction
Contextualized word representations have proven useful for various natural language processing tasks. However, it remains unclear to what extent these representations can cover hand-coded semantic information such as semantic frames, which specify the semantic role of the arguments associated with a predicate. In this paper, we focus on verbs that evoke different frames depending on the context, and we investigate how well contextualized word representations can recognize the difference of frames that the same verb evokes. We also explore which types of representation are suitable for semantic frame induction. In our experiments, we compare seven different contextualized word representations for two English frame-semantic resources, FrameNet and PropBank. We demonstrate that several contextualized word representations, especially BERT and its variants, are considerably informative for semantic frame induction. Furthermore, we examine the extent to which the contextualized representation of a verb can estimate the number of frames that the verb can evoke.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
L2F/INESC-ID at SemEval-2019 Task 2: Unsupervised Lexical Semantic Frame Induction using Contextualized Word Representations
Building large datasets annotated with semantic information, such as FrameNet, is an expensive process. Consequently, such resources are unavailable for many languages and specific domains. This problem can be alleviated…
ClusteringGraph ClusteringTask 2Word Sense DisambiguationLost in Context? On the Sense-wise Variance of Contextualized Word Embeddings
Contextualized word embeddings in language models have given much advance to NLP. Intuitively, sentential information is integrated into the representation of words, which can help model polysemy. However, context sensit…
PositionSentenceWord EmbeddingsWord Sense DisambiguationImproved Word Sense Disambiguation Using Pre-Trained Contextualized Word Representations
Contextualized word representations are able to give different representations for the same word in different contexts, and they have been shown to be effective in downstream natural language processing tasks, such as qu…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Question Answering+3Semantic Frame Induction using Masked Word Embeddings and Two-Step Clustering
Recent studies on semantic frame induction show that relatively high performance has been achieved by using clustering-based methods with contextualized word embeddings. However, there are two potential drawbacks to thes…
ClusteringVocal Bursts Valence PredictionWord EmbeddingsSparsity Makes Sense: Word Sense Disambiguation Using Sparse Contextualized Word Representations
In this paper, we demonstrate that by utilizing sparse word representations, it becomes possible to surpass the results of more complex task-specific models on the task of fine-grained all-words word sense disambiguation…
Part-Of-Speech TaggingWord Sense Disambiguation