Cross-Lingual Training of Neural Models for Document Ranking
We tackle the challenge of cross-lingual training of neural document ranking models for mono-lingual retrieval, specifically leveraging relevance judgments in English to improve search in non-English languages. Our work successfully applies multi-lingual BERT (mBERT) to document ranking and additionally compares against a number of alternatives: translating the training data, translating documents, multi-stage hybrids, and ensembles. Experiments on test collections in six different languages from diverse language families reveal many interesting findings: model-based relevance transfer using mBERT can significantly improve search quality in (non-English) mono-lingual retrieval, but other {``}low resource{''} approaches are competitive as well.
Code (0)
등록된 구현이 없습니다.
Tasks
Document RankingRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
What Drives Cross-lingual Ranking? Retrieval Approaches with Multilingual Language Models
Cross-lingual information retrieval (CLIR) enables access to multilingual knowledge but remains challenging due to disparities in resources, scripts, and weak cross-lingual semantic alignment in embedding models. Existin…
Information RetrievalContrastive LearningLAMAR: An Open Language-Aware Multilingual Alignment Reranker
In multilingual retrieval augmented generation, a retriever can retrieve relevant documents written in multiple languages, which are subsequently reranked before answer generation. However, it remains unclear whether exi…
Answer GenerationImproving Low-Resource Cross-lingual Document Retrieval by Reranking with Deep Bilingual Representations
In this paper, we propose to boost low-resource cross-lingual document retrieval performance with deep bilingual query-document representations. We match queries and documents in both source and target languages with fou…
Cross-Lingual Information RetrievalCross-Lingual Word EmbeddingsInformation RetrievalReranking+3Zero-Shot Cross-Lingual Reranking with Large Language Models for Low-Resource Languages
Large language models (LLMs) have shown impressive zero-shot capabilities in various document reranking tasks. Despite their successful implementations, there is still a gap in existing literature on their effectiveness …
Cross-Lingual Information RetrievalInformation RetrievalRerankingRetrievalImproving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillation
Benefiting from transformer-based pre-trained language models, neural ranking models have made significant progress. More recently, the advent of multilingual pre-trained language models provides great support for design…
Cross-Lingual Information RetrievalDocument RankingInformation RetrievalMachine Translation+1