Improving Word Alignment of Rare Words with Word Embeddings
We address the problem of inducing word alignment for language pairs by developing an unsupervised model with the capability of getting applied to other generative alignment models. We approach the task by: i)proposing a new alignment model based on the IBM alignment model 1 that uses vector representation of words, and ii)examining the use of similar source words to overcome the problem of rare source words and improving the alignments. We apply our method to English-French corpora and run the experiments with different sizes of sentence pairs. Our results show competitive performance against the baseline and in some cases improve the results up to 6.9{\%} in terms of precision.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationSentenceWord AlignmentWord EmbeddingsSimilar Papers 제목 키워드 기반
Learning to Compute Word Embeddings On the Fly
Words in natural language follow a Zipfian distribution whereby some words are frequent but most are rare. Learning representations for words in the "long tail" of this distribution requires enormous amounts of data. Rep…
Language ModelingLanguage ModellingNatural Language InferenceQuestion Answering+2Evaluating bilingual word embeddings on the long tail
Bilingual word embeddings are useful for bilingual lexicon induction, the task of mining translations of given words. Many studies have shown that bilingual word embeddings perform well for bilingual lexicon induction bu…
Bilingual Lexicon InductionMachine TranslationWord EmbeddingsSub-Word Similarity based Search for Embeddings: Inducing Rare-Word Embeddings for Word Similarity Tasks and Language Modelling
Training good word embeddings requires large amounts of data. Out-of-vocabulary words will still be encountered at test-time, leaving these words without embeddings. To overcome this lack of embeddings for rare words, ex…
Language ModelingLanguage ModellingMorphological AnalysisWord Embeddings+1Learning Embeddings for Rare Words Leveraging Internet Search Engine and Spatial Location Relationships
Word embedding techniques depend heavily on the frequencies of words in the corpus, and are negatively impacted by failures in providing reliable representations for low-frequency words or unseen words during training. T…
Word EmbeddingsWAGS: A Beautiful English-Italian Benchmark Supporting Word Alignment Evaluation on Rare Words
This paper presents WAGS (Word Alignment Gold Standard), a novel benchmark which allows extensive evaluation of WA tools on out-of-vocabulary (OOV) and rare words. WAGS is a subset of the Common Test section of the Europ…
SentenceWord Alignment