paper-with-me

Papers

Bridging the Language Gap: Knowledge Injected Multilingual Question Answering

2023-04-06 · Zhichao Duan, Xiuxing Li, Zhengyan Zhang, Zhenyu Li, Ning Liu, Jianyong Wang

Question Answering (QA) is the task of automatically answering questions posed by humans in natural languages. There are different settings to answer a question, such as abstractive, extractive, boolean, and multiple-choice QA. As a popular topic in natural language processing tasks, extractive question answering task (extractive QA) has gained extensive attention in the past few years. With the continuous evolvement of the world, generalized cross-lingual transfer (G-XLT), where question and answer context are in different languages, poses some unique challenges over cross-lingual transfer (XLT), where question and answer context are in the same language. With the boost of corresponding development of related benchmarks, many works have been done to improve the performance of various language QA tasks. However, only a few works are dedicated to the G-XLT task. In this work, we propose a generalized cross-lingual transfer framework to enhance the model's ability to understand different languages. Specifically, we first assemble triples from different languages to form multilingual knowledge. Since the lack of knowledge between different languages greatly limits models' reasoning ability, we further design a knowledge injection strategy via leveraging link prediction techniques to enrich the model storage of multilingual knowledge. In this way, we can profoundly exploit rich semantic knowledge. Experiment results on real-world datasets MLQA demonstrate that the proposed method can improve the performance by a large margin, outperforming the baseline method by 13.18%/12.00% F1/EM on average.

📄 PDF Abstract BibTeX arXiv:2304.03159

Code (0)

등록된 구현이 없습니다.

Tasks

Cross-Lingual TransferExtractive Question-AnsweringLink PredictionMultiple-choiceQuestion Answering

Similar Papers 제목 키워드 기반

Do Language Models Reason Across Languages?

2026-01-10 · Yan Meng, Wafaa Mohammed, Christof Monz arxiv

The real-world information sources are inherently multilingual, which naturally raises a question about whether language models can synthesize information across languages. In this paper, we introduce a simple two-hop qu…

Question Answering

Increasing Coverage and Precision of Textual Information in Multilingual Knowledge Graphs

2023-11-27 · Simone Conia, Min Li, Daniel Lee, Umar Farooq Minhas 외

Recent work in Natural Language Processing and Computer Vision has been using textual information -- e.g., entity names and descriptions -- available in knowledge graphs to ground neural models to high-quality structured…

Entity LinkingKnowledge Graph CompletionKnowledge GraphsMachine Translation+1

PropMEND: Hypernetworks for Knowledge Propagation in LLMs

2025-06-10 · Zeyu Leo Liu, Greg Durrett, Eunsol Choi

Knowledge editing techniques for large language models (LLMs) can inject knowledge that is later reproducible verbatim, but they fall short on propagating that knowledge: models cannot answer questions that require reaso…

knowledge editingLanguage ModelingLanguage Modelling

Is It Good Data for Multilingual Instruction Tuning or Just Bad Multilingual Evaluation for Large Language Models?

2024-06-18 · Pinzhen Chen, Simon Yu, Zhicheng Guo, Barry Haddow

Multilingual large language models are designed, claimed, and expected to cater to speakers of varied languages. We hypothesise that the current practices of fine-tuning and evaluating these models may not perfectly alig…

Translation

Mitigating Negative Interference in Multilingual Sequential Knowledge Editing through Null-Space Constraints

2025-06-12 · Wei Sun, Tingyu Qu, Mingxiao Li, Jesse Davis 외

Efficiently updating multilingual knowledge in large language models (LLMs), while preserving consistent factual representations across languages, remains a long-standing and unresolved challenge. While deploying separat…

knowledge editing