Improving Low-Resource Cross-lingual Document Retrieval by Reranking with Deep Bilingual Representations
In this paper, we propose to boost low-resource cross-lingual document retrieval performance with deep bilingual query-document representations. We match queries and documents in both source and target languages with four components, each of which is implemented as a term interaction-based deep neural network with cross-lingual word embeddings as input. By including query likelihood scores as extra features, our model effectively learns to rerank the retrieved documents by using a small number of relevance labels for low-resource language pairs. Due to the shared cross-lingual word embedding space, the model can also be directly applied to another language pair without any training label. Experimental results on the MATERIAL dataset show that our model outperforms the competitive translation-based baselines on English-Swahili, English-Tagalog, and English-Somali cross-lingual information retrieval tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual Information RetrievalCross-Lingual Word EmbeddingsInformation RetrievalRerankingRetrievalTranslationWord EmbeddingsSimilar Papers 제목 키워드 기반
Zero-Shot Cross-Lingual Reranking with Large Language Models for Low-Resource Languages
Large language models (LLMs) have shown impressive zero-shot capabilities in various document reranking tasks. Despite their successful implementations, there is still a gap in existing literature on their effectiveness …
Cross-Lingual Information RetrievalInformation RetrievalRerankingRetrievalLAMAR: An Open Language-Aware Multilingual Alignment Reranker
In multilingual retrieval augmented generation, a retriever can retrieve relevant documents written in multiple languages, which are subsequently reranked before answer generation. However, it remains unclear whether exi…
Answer GenerationPivot Through English: Reliably Answering Multilingual Questions without Document Retrieval
Existing methods for open-retrieval question answering in lower resource languages (LRLs) lag significantly behind English. They not only suffer from the shortcomings of non-English document retrieval, but are reliant on…
Answer GenerationQuestion AnsweringRerankingRetrieval+3Zero-Shot Listwise Document Reranking with a Large Language Model
Supervised ranking methods based on bi-encoder or cross-encoder architectures have shown success in multi-stage text ranking tasks, but they require large amounts of relevance judgments as training data. In this work, we…
Language ModelingLanguage ModellingLarge Language ModelReranking+1Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Data
Transferring information retrieval (IR) models from a high-resource language (typically English) to other languages in a zero-shot fashion has become a widely adopted approach. In this work, we show that the effectivenes…
Cross-Lingual Word EmbeddingsInformation RetrievalRerankingRetrieval+1