paper-with-me

홈 › Papers

CL-ReLKT: Cross-lingual Language Knowledge Transfer for Multilingual Retrieval Question Answering

2022-07-01 · Findings (NAACL) 2022 7 · Peerat Limkonchotiwat, Wuttikorn Ponwitayarat, Can Udomcharoenchaikit, Ekapol Chuangsuwanich, Sarana Nutanong

Cross-Lingual Retrieval Question Answering (CL-ReQA) is concerned with retrieving answer documents or passages to a question written in a different language. A common approach to CL-ReQA is to create a multilingual sentence embedding space such that question-answer pairs across different languages are close to each other. In this paper, we propose a novel CL-ReQA method utilizing the concept of language knowledge transfer and a new cross-lingual consistency training technique to create a multilingual embedding space for ReQA. To assess the effectiveness of our work, we conducted comprehensive experiments on CL-ReQA and a downstream task, machine reading QA. We compared our proposed method with the current state-of-the-art solutions across three public CL-ReQA corpora. Our method outperforms competitors in 19 out of 21 settings of CL-ReQA. When used with a downstream machine reading QA task, our method outperforms the best existing language-model-based method by 10% in F1 while being 10 times faster in sentence embedding computation. The code and models are available at https://github.com/mrpeerat/CL-ReLKT.

📄 PDF Abstract BibTeX

Code (1)

mrpeerat/cl-relkt 공식 구현 tf

Tasks

Language ModelingLanguage ModellingQuestion AnsweringReading ComprehensionRetrievalSentenceSentence EmbeddingSentence-EmbeddingTransfer Learning

Similar Papers 제목 키워드 기반

Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Models

2024-02-03 · Sara Rajaee, Christof Monz

Recent advances in training multilingual language models on large datasets seem to have shown promising results in knowledge transfer across languages and achieve high performance on downstream tasks. However, we questio…

Transfer Learning

LiveCLKTBench: Towards Reliable Evaluation of Cross-Lingual Knowledge Transfer in Multilingual LLMs

2025-11-03 · Pei-Fu Guo, Yun-Da Tsai, Chun-Chia Hsu, Kai-Xin Chen 외 arxiv

Evaluating cross-lingual knowledge transfer in large language models is challenging, as correct answers in a target language may arise either from genuine transfer or from prior exposure during pre-training. We present L…

Cross-Lingual Transfer

Cross-Lingual Transfer Learning for POS Tagging without Cross-Lingual Resources

2017-09-01 · EMNLP 2017 9 · Joo-Kyung Kim, Young-Bum Kim, Ruhi Sarikaya, Eric Fosler-Lussier

Training a POS tagging model with crosslingual transfer learning usually requires linguistic knowledge and resources about the relation between the source language and the target language. In this paper, we introduce a c…

Cross-Lingual TransferLanguage ModelingLanguage ModellingNamed Entity Recognition (NER)+6

ECLeKTic: a Novel Challenge Set for Evaluation of Cross-Lingual Knowledge Transfer

2025-02-28 · Omer Goldman, Uri Shaham, Dan Malkin, Sivan Eiger 외

To achieve equitable performance across languages, multilingual large language models (LLMs) must be able to abstract knowledge beyond the language in which it was acquired. However, the current literature lacks reliable…

ArticlesTransfer Learning

Cross-Lingual Transfer for Natural Language Inference via Multilingual Prompt Translator

2024-03-19 · Xiaoyu Qiu, Yuechen Wang, Jiaxin Shi, Wengang Zhou 외

Based on multilingual pre-trained models, cross-lingual transfer with prompt learning has shown promising effectiveness, where soft prompt learned in a source language is transferred to target languages for downstream ta…

Cross-Lingual TransferNatural Language InferencePrompt Learning