A graph-based analysis of semantic types and coercion in contextualized word embeddings
Semantic type mismatch between a noun and its context is central to coercion phenomena. This paper introduces a graph-based method to examine how lexical and contextual type information is reflected in word embeddings. We select nouns from ten semantic types, annotate corpus instances for type matching (matching vs. coercion vs. other mismatch vs. unrestricted), and construct graphs using BERT and sense-enhanced embeddings. Two metrics -- Neighbor Type Probability (NTP) and Neighbor Type Entropy (NTE) -- are proposed to analyze neighborhood type distributions. Results show that graphs constructed with sense-enhanced embeddings reflect semantic type information better, and matching and mismatch sentences can be distinguished through the proposed metrics.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Annotating Croatian Semantic Type Coercions in CROATPAS
This short research paper presents the results of a corpus-based metonymy annotation exercise on a sample of 101 Croatian verb entries {--} corresponding to 457 patters and over 20,000 corpus lines {--} taken from CROATP…
Vocal Bursts Type PredictionContextualized language models for semantic change detection: lessons learned
We present a qualitative analysis of the (potentially erroneous) outputs of contextualized embedding-based methods for detecting diachronic semantic change. First, we introduce an ensemble method outperforming previously…
Change DetectionA Distributional Model of Affordances in Semantic Type Coercion
We explore a novel application for interpreting semantic type coercions, motivated by insight into the role that perceptual affordances play in the selection of the semantic roles of artefactual nouns which are observed …
Vocal Bursts Type PredictionA Geometric Method for Detecting Semantic Coercion
Semantic Role Labeling for Knowledge Graph Extraction from Text
This paper introduces TakeFive, a new semantic role labeling method that transforms a text into a frame-oriented knowledge graph. It performs dependency parsing, identifies the words that evoke lexical frames, locates th…
Dependency ParsingSemantic Role Labeling