TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media
Language evolves over time, and word meaning changes accordingly. This is especially true in social media, since its dynamic nature leads to faster semantic shifts, making it challenging for NLP models to deal with new content and trends. However, the number of datasets and models that specifically address the dynamic nature of these social platforms is scarce. To bridge this gap, we present TempoWiC, a new benchmark especially aimed at accelerating research in social media-based meaning shift. Our results show that TempoWiC is a challenging benchmark, even for recently-released language models specialized in social media.
Code (1)
Similar Papers 제목 키워드 기반
Using Deep Mixture-of-Experts to Detect Word Meaning Shift for TempoWiC
This paper mainly describes the dma submission to the TempoWiC task, which achieves a macro-F1 score of 77.05% and attains the first place in this task. We first explore the impact of different pre-trained language model…
Data AugmentationMixture-of-ExpertsPOSUsing Two Losses and Two Datasets Simultaneously to Improve TempoWiC Accuracy
WSD (Word Sense Disambiguation) is the task of identifying which sense of a word is meant in a sentence or other segment of text. Researchers have worked on this task (e.g. Pustejovsky, 2002) for years but it's still a c…
SentenceVocal Bursts Valence PredictionWord Sense DisambiguationStill a Pain in the Neck: Evaluating Text Representations on Lexical Composition
Building meaningful phrase representations is challenging because phrase meanings are not simply the sum of their constituent meanings. Lexical composition can shift the meanings of the constituent words and introduce im…
Word Embeddings(Chat)GPT v BERT: Dawn of Justice for Semantic Change Detection
In the universe of Natural Language Processing, Transformer-based language models like BERT and (Chat)GPT have emerged as lexical superheroes with great power to solve open research problems. In this paper, we specifical…
Change DetectionDetecting Contact-Induced Semantic Shifts: What Can Embedding-Based Methods Do in Practice?
This study investigates the applicability of semantic change detection methods in descriptively oriented linguistic research. It specifically focuses on contact-induced semantic shifts in Quebec English. We contrast sync…
Change Detection