Language Modelling with NMT Query Translation for Amharic-Arabic Cross-Language Information Retrieval
This paper describes our first experiment on Neural Machine Translation (NMT) based query translation for Amharic-Arabic Cross-Language Information Retrieval (CLIR) task to retrieve relevant documents from Amharic and Arabic text collections in response to a query expressed in the Amharic language. We used a pre-trained NMT model to map a query in the source language into an equivalent query in the target language. The relevant documents are then retrieved using a Language Modeling (LM) based retrieval algorithm. Experiments are conducted on four conventional IR models, namely Uni-gram and Bi-gram LM, Probabilistic model, and Vector Space Model (VSM). The results obtained illustrate that the proposed Uni-gram LM outperforms all other models for both Amharic and Arabic language document collections.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalLanguage ModelingLanguage ModellingMachine TranslationNMTRetrievalTranslationSimilar Papers 제목 키워드 기반
Amharic-Arabic Neural Machine Translation
Many automatic translation works have been addressed between major European language pairs, by taking advantage of large scale parallel corpora, but very few research works are conducted on the Amharic-Arabic language pa…
DecoderMachine TranslationNMTTranslationANEC: An Amharic Named Entity Corpus and Transformer Based Recognizer
Named Entity Recognition is an information extraction task that serves as a preprocessing step for other natural language processing tasks, such as machine translation, information retrieval, and question answering. Name…
imbalanced classificationInformation RetrievalMachine Translationnamed-entity-recognition+4The Effect of Normalization for Bi-directional Amharic-English Neural Machine Translation
Machine translation (MT) is one of the main tasks in natural language processing whose objective is to translate texts automatically from one natural language to another. Nowadays, using deep neural networks for MT tasks…
Machine TranslationSentenceTranslationEvaluating Amharic Machine Translation
Machine translation (MT) systems are now able to provide very accurate results for high resource language pairs. However, for many low resource languages, MT is still under active research. In this paper, we develop and …
Machine TranslationTranslationAmharicIR+Instr: A Two-Dataset Resource for Neural Retrieval and Instruction Tuning
Neural retrieval and GPT-style generative models rely on large, high-quality supervised data, which is still scarce for low-resource languages such as Amharic. We release an Amharic data resource consisting of two datase…
Text Generation