Cross-Lingual Phrase Retrieval
Cross-lingual retrieval aims to retrieve relevant text across languages. Current methods typically achieve cross-lingual retrieval by learning language-agnostic text representations in word or sentence level. However, how to learn phrase representations for cross-lingual phrase retrieval is still an open problem. In this paper, we propose XPR, a cross-lingual phrase retriever that extracts phrase representations from unlabeled example sentences. Moreover, we create a large-scale cross-lingual phrase retrieval dataset, which contains 65K bilingual phrase pairs and 4.2M example sentences in 8 English-centric language pairs. Experimental results show that XPR outperforms state-of-the-art baselines which utilize word-level or sentence-level representations. XPR also shows impressive zero-shot transferability that enables the model to perform retrieval in an unseen language pair during training. Our dataset, code, and trained models are publicly available at www.github.com/cwszz/XPR/.
Code (1)
Tasks
RetrievalSentenceSimilar Papers 제목 키워드 기반
Cross-lingual Contextualized Phrase Retrieval
Phrase-level dense retrieval has shown many appealing characteristics in downstream NLP tasks by leveraging the fine-grained information that phrases offer. In our work, we propose a new task formulation of dense retriev…
Contrastive LearningLanguage ModellingLarge Language ModelMachine Translation+2Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training
Keyphrase generation is the task of automatically predicting keyphrases given a piece of long text. Despite its recent flourishing, keyphrase generation on non-English languages haven't been vastly investigated. In this …
Keyphrase GenerationPassage RetrievalRetrievalBoosting Cross-Language Retrieval by Learning Bilingual Phrase Associations from Relevance Rankings
What Drives Cross-lingual Ranking? Retrieval Approaches with Multilingual Language Models
Cross-lingual information retrieval (CLIR) enables access to multilingual knowledge but remains challenging due to disparities in resources, scripts, and weak cross-lingual semantic alignment in embedding models. Existin…
Information RetrievalContrastive LearningH+ Embedding: Harmonizing Global and Token-Level Retrieval with Context-Dependent Phrases
Terminology-intensive retrieval, especially in medical settings, depends on preserving multi-word entities, abbreviations, numerical constraints, and compositional concepts. However, existing representations lie at two e…