Quantum-inspired Representation for Long-tail Senses of Word Sense Disambiguation
Data imbalance, also known as the long-tailed distribution of data, is an important challenge for data-driven models. Due to the long tail phenomenon of word sense distribution in linguistics, it is difficult to learn accurate representations for Long-Tail Senses (LTSs) in Word Sense Disambiguation (WSD) tasks. Without data augmentation, exploring representation methods that do not rely on large sample sizes is an important means to combat the long tail. In this paper, inspired by the superposition state in quantum mechanics, a representation method in Hilbert space is proposed to reduce the dependence on large sample sizes. We theoretically prove the correctness of the method, verify its effectiveness on the WSD task, and achieve state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationWord Sense DisambiguationSimilar Papers 제목 키워드 기반
The Quantum LLM: Modeling Semantic Spaces with Quantum Principles
In the previous article, we presented a quantum-inspired framework for modeling semantic representation and processing in Large Language Models (LLMs), drawing upon mathematical tools and conceptual analogies from quantu…
Response GenerationvalidBERT Has Uncommon Sense: Similarity Ranking for Word Sense BERTology
An important question concerning contextualized word embedding (CWE) models like BERT is how well they can represent different word senses, especially those in the long tail of uncommon senses. Rather than build a WSD sy…
RetrievalMoving Down the Long Tail of Word Sense Disambiguation with Gloss-Informed Biencoders
A major obstacle in Word Sense Disambiguation (WSD) is that word senses are not uniformly distributed, causing existing models to generally perform poorly on senses that are either rare or unseen during training. We prop…
Word Sense DisambiguationMoving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encoders
A major obstacle in Word Sense Disambiguation (WSD) is that word senses are not uniformly distributed, causing existing models to generally perform poorly on senses that are either rare or unseen during training. We prop…
Word Sense DisambiguationBi-Matching Mechanism to Combat the Long Tail of Word Sense Disambiguation
The long tail phenomenon of word sense distribution in linguistics causes the Word Sense Disambiguation (WSD) task to face a serious polarization of word sense distribution, that is, Most Frequent Senses (MFSs) with huge…
Few-Shot LearningWord Sense Disambiguation