paper-with-me

홈 › Papers

Cross-Lingual Training of Neural Models for Document Ranking

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Peng Shi, He Bai, Jimmy Lin

We tackle the challenge of cross-lingual training of neural document ranking models for mono-lingual retrieval, specifically leveraging relevance judgments in English to improve search in non-English languages. Our work successfully applies multi-lingual BERT (mBERT) to document ranking and additionally compares against a number of alternatives: translating the training data, translating documents, multi-stage hybrids, and ensembles. Experiments on test collections in six different languages from diverse language families reveal many interesting findings: model-based relevance transfer using mBERT can significantly improve search quality in (non-English) mono-lingual retrieval, but other {``}low resource{''} approaches are competitive as well.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Document RankingRetrieval

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
mBERT mBERT
Adam 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

What Drives Cross-lingual Ranking? Retrieval Approaches with Multilingual Language Models

2025-11-24 · Roksana Goworek, Olivia Macmillan-Scott, Eda B. Özyiğit arxiv

Cross-lingual information retrieval (CLIR) enables access to multilingual knowledge but remains challenging due to disparities in resources, scripts, and weak cross-lingual semantic alignment in embedding models. Existin…

Information RetrievalContrastive Learning

LAMAR: An Open Language-Aware Multilingual Alignment Reranker

2026-07-24 · Seongtae Hong, Youngjoon Jang, Jungseob Lee, Seungyoon Lee 외 hf

In multilingual retrieval augmented generation, a retriever can retrieve relevant documents written in multiple languages, which are subsequently reranked before answer generation. However, it remains unclear whether exi…

Answer Generation

Improving Low-Resource Cross-lingual Document Retrieval by Reranking with Deep Bilingual Representations

2019-06-08 · ACL 2019 7 · Rui Zhang, Caitlin Westerfield, Sungrok Shim, Garrett Bingham 외

In this paper, we propose to boost low-resource cross-lingual document retrieval performance with deep bilingual query-document representations. We match queries and documents in both source and target languages with fou…

Cross-Lingual Information RetrievalCross-Lingual Word EmbeddingsInformation RetrievalReranking+3

Zero-Shot Cross-Lingual Reranking with Large Language Models for Low-Resource Languages

2023-12-26 · Mofetoluwa Adeyemi, Akintunde Oladipo, Ronak Pradeep, Jimmy Lin

Large language models (LLMs) have shown impressive zero-shot capabilities in various document reranking tasks. Despite their successful implementations, there is still a gap in existing literature on their effectiveness …

Cross-Lingual Information RetrievalInformation RetrievalRerankingRetrieval

Improving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillation

2023-01-29 · Zhiqi Huang, Puxuan Yu, James Allan

Benefiting from transformer-based pre-trained language models, neural ranking models have made significant progress. More recently, the advent of multilingual pre-trained language models provides great support for design…

Cross-Lingual Information RetrievalDocument RankingInformation RetrievalMachine Translation+1