Rethinking Metrics for Lexical Semantic Change Detection
Lexical semantic change detection (LSCD) increasingly relies on contextualised language model embeddings, yet most approaches still quantify change using a small set of semantic change metrics, primarily Average Pairwise Distance (APD) and cosine distance over word prototypes (PRT). We introduce Average Minimum Distance (AMD) and Symmetric Average Minimum Distance (SAMD), new measures that quantify semantic change via local correspondence between word usages across time periods. Across multiple languages, encoder models, and representation spaces, we show that AMD often provides more robust performance, particularly under dimensionality reduction and with non-specialised encoders, while SAMD excels with specialised encoders. We suggest that LSCD may benefit from considering alternative semantic change metrics beyond APD and PRT, with AMD offering a robust option for contextualised embedding-based analysis.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionChange DetectionSimilar Papers 제목 키워드 기반
When Lexical Change Misleads: Rethinking Dynamic Topic Model Evaluation with Traditional and LLM-Based Metrics
Dynamic topic models capture evolving word distributions, but traditional coherence metrics may fail when vocabulary changes while semantic meaning persists. We evaluate 120 topics from CoNTM and DLDA across NYT, DBLP, a…
Semantic SimilarityTopic ModelsDiaSense at SemEval-2020 Task 1: Modeling Sense Change via Pre-trained BERT Embeddings
This paper describes DiaSense, a system developed for Task 1 {`}Unsupervised Lexical Semantic Change Detection{'} of SemEval 2020. In DiaSense, contextualized word embeddings are used to model word sense changes. This al…
Change DetectionWord EmbeddingsSimulating Lexical Semantic Change from Sense-Annotated Data
We present a novel procedure to simulate lexical semantic change from synchronic sense-annotated data, and demonstrate its usefulness for assessing lexical semantic change detection models. The induced dataset represents…
Change DetectionUnsupervised Embedding-based Detection of Lexical Semantic Changes
This paper describes EmbLexChange, a system introduced by the "Life-Language" team for SemEval-2020 Task 1, on unsupervised detection of lexical-semantic changes. EmbLexChange is defined as the divergence between the emb…
EmbLexChange at SemEval-2020 Task 1: Unsupervised Embedding-based Detection of Lexical Semantic Changes
This paper describes EmbLexChange, a system introduced by the {``}Life-Language{''} team for SemEval-2020 Task 1, on unsupervised detection of lexical-semantic changes. EmbLexChange is defined as the divergence between t…