Unsupervised Multi-hop Question Answering by Question Generation
Obtaining training data for multi-hop question answering (QA) is time-consuming and resource-intensive. We explore the possibility to train a well-performed multi-hop QA model without referencing any human-labeled multi-hop question-answer pairs, i.e., unsupervised multi-hop QA. We propose MQA-QG, an unsupervised framework that can generate human-like multi-hop training data from both homogeneous and heterogeneous data sources. MQA-QG generates questions by first selecting/generating relevant information from each data source and then integrating the multiple information to form a multi-hop question. Using only generated training data, we can train a competent multi-hop QA which achieves 61% and 83% of the supervised learning performance for the HybridQA and the HotpotQA dataset, respectively. We also show that pretraining the QA system with the generated data would greatly reduce the demand for human-annotated training data. Our codes are publicly available at https://github.com/teacherpeterpan/Unsupervised-Multi-hop-QA.
Code (1)
Tasks
Multi-hop Question AnsweringQuestion AnsweringQuestion GenerationQuestion-GenerationSimilar Papers 제목 키워드 기반
Fine-Tuning vs. RAG for Multi-Hop Question Answering with Novel Knowledge
Multi-hop question answering is widely used to evaluate the reasoning capabilities of large language models (LLMs), as it requires integrating multiple pieces of supporting knowledge to arrive at a correct answer. While …
Multi-hop Question AnsweringScience Question AnsweringContinual PretrainingTSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering
Unsupervised commonsense question answering requires mining effective commonsense knowledge without the rely on the labeled task data. Previous methods typically retrieved from traditional knowledge bases or used pre-tra…
Answer GenerationQuestion AnsweringVocal Bursts Valence PredictionUnsupervised Domain Adaptation on Question-Answering System with Conversation Data
Machine reading comprehension (MRC) is a task for question answering that finds answers to questions from documents of knowledge. Most studies on the domain adaptation of MRC require documents describing knowledge of the…
Domain AdaptationMachine Reading ComprehensionQuestion AnsweringReading Comprehension+1Unsupervised Question Decomposition for Question Answering
We aim to improve question answering (QA) by decomposing hard questions into simpler sub-questions that existing QA systems are capable of answering. Since labeling questions with decompositions is cumbersome, we take an…
Question AnsweringTemplate-Based Question Generation from Retrieved Sentences for Improved Unsupervised Question Answering
Question Answering (QA) is in increasing demand as the amount of information available online and the desire for quick access to this content grows. A common approach to QA has been to fine-tune a pretrained language mod…
Language ModelingLanguage ModellingQuestion AnsweringQuestion Generation+2