Enhancing Translation Language Models with Word Embedding for Information Retrieval
In this paper, we explore the usage of Word Embedding semantic resources for Information Retrieval (IR) task. This embedding, produced by a shallow neural network, have been shown to catch semantic similarities between words (Mikolov et al., 2013). Hence, our goal is to enhance IR Language Models by addressing the term mismatch problem. To do so, we applied the model presented in the paper Integrating and Evaluating Neural Word Embedding in Information Retrieval by Zuccon et al. (2015) that proposes to estimate the translation probability of a Translation Language Model using the cosine similarity between Word Embedding. The results we obtained so far did not show a statistically significant improvement compared to classical Language Model.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalLanguage ModelingLanguage ModellingRetrievalTranslationSimilar Papers 제목 키워드 기반
Can We Use Word Embeddings for Enhancing Guarani-Spanish Machine Translation?
Machine translation for low-resource languages, such as Guarani, is a challenging task due to the lack of data. One way of tackling it is using pretrained word embeddings for model initialization. In this work we try to …
Machine TranslationTranslationWord EmbeddingsUsingWord Embeddings for Query Translation for Hindi to English Cross Language Information Retrieval
Cross-Language Information Retrieval (CLIR) has become an important problem to solve in the recent years due to the growth of content in multiple languages in the Web. One of the standard methods is to use query translat…
Information RetrievalRetrievalTranslationWord Embeddings+1Enhancing Cross-lingual Sentence Embedding for Low-resource Languages with Word Alignment
The field of cross-lingual sentence embeddings has recently experienced significant advancements, but research concerning low-resource languages has lagged due to the scarcity of parallel corpora. This paper shows that c…
RetrievalSentenceSentence EmbeddingSentence-Embedding+4Query Translation for Cross-Language Information Retrieval using Multilingual Word Clusters
In Cross-Language Information Retrieval, finding the appropriate translation of the source language query has always been a difficult problem to solve. We propose a technique towards solving this problem with the help of…
Community DetectionInformation RetrievalMachine TranslationMultilingual Word Embeddings+4Word and Phrase Translation with word2vec
Word and phrase tables are key inputs to machine translations, but costly to produce. New unsupervised learning methods represent words and phrases in a high-dimensional vector space, and these monolingual embeddings hav…
Translation