Improving Bilingual Lexicon Induction for Low Frequency Words
This paper designs a Monolingual Lexicon Induction task and observes that two factors accompany the degraded accuracy of bilingual lexicon induction for rare words. First, a diminishing margin between similarities in low frequency regime, and secondly, exacerbated hubness at low frequency. Based on the observation, we further propose two methods to address these two factors, respectively. The larger issue is hubness. Addressing that improves induction accuracy significantly, especially for low-frequency words.
Code (0)
등록된 구현이 없습니다.
Tasks
Bilingual Lexicon InductionSimilar Papers 제목 키워드 기반
A Comprehensive Analysis of Bilingual Lexicon Induction
Bilingual lexicon induction is the task of inducing word translations from monolingual corpora in two languages. In this article we present the most comprehensive analysis of bilingual lexicon induction to date. We prese…
Bilingual Lexicon InductionMachine TranslationTranslationEvaluating bilingual word embeddings on the long tail
Bilingual word embeddings are useful for bilingual lexicon induction, the task of mining translations of given words. Many studies have shown that bilingual word embeddings perform well for bilingual lexicon induction bu…
Bilingual Lexicon InductionMachine TranslationWord EmbeddingsLow-resource Bilingual Dialect Lexicon Induction with Large Language Models
Bilingual word lexicons are crucial tools for multilingual natural language understanding and machine translation tasks, as they facilitate the mapping of words in one language to their synonyms in another language. To a…
Bilingual Lexicon InductionMachine TranslationNatural Language UnderstandingSemantic Similarity+3A Graph-based Coarse-to-fine Method for Unsupervised Bilingual Lexicon Induction
Unsupervised bilingual lexicon induction is the task of inducing word translations from monolingual corpora of two languages. Recent methods are mostly based on unsupervised cross-lingual word embeddings, the key to whic…
Bilingual Lexicon InductionCross-Lingual Word EmbeddingsWord EmbeddingsWord TranslationAn Alignment-Based Approach to Semi-Supervised Bilingual Lexicon Induction with Small Parallel Corpora
Aimed at generating a seed lexicon for use in downstream natural language tasks and unsupervised methods for bilingual lexicon induction have received much attention in the academic literature recently. While interesting…
Bilingual Lexicon InductionTranslation