Unsupervised multiple choices question answering via universal corpus
Unsupervised question answering is a promising yet challenging task, which alleviates the burden of building large-scale annotated data in a new domain. It motivates us to study the unsupervised multiple-choice question answering (MCQA) problem. In this paper, we propose a novel framework designed to generate synthetic MCQA data barely based on contexts from the universal domain without relying on any form of manual annotation. Possible answers are extracted and used to produce related questions, then we leverage both named entities (NE) and knowledge graphs to discover plausible distractors to form complete synthetic samples. Experiments on multiple MCQA datasets demonstrate the effectiveness of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
FormKnowledge GraphsMultiple-choiceMultiple Choice Question Answering (MCQA)Question AnsweringSimilar Papers 제목 키워드 기반
Unsupervised Multiple Choices Question Answering: Start Learning from Basic Knowledge
In this paper, we study the possibility of almost unsupervised Multiple Choices Question Answering (MCQA). Starting from very basic knowledge, MCQA model knows that some choices have higher probabilities of being correct…
Question AnsweringTSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering
Unsupervised commonsense question answering requires mining effective commonsense knowledge without the rely on the labeled task data. Previous methods typically retrieved from traditional knowledge bases or used pre-tra…
Answer GenerationQuestion AnsweringVocal Bursts Valence PredictionDifferentiating Choices via Commonality for Multiple-Choice Question Answering
Multiple-choice question answering (MCQA) becomes particularly challenging when all choices are relevant to the question and are semantically similar. Yet this setting of MCQA can potentially provide valuable clues for c…
Multiple-choiceMultiple Choice Question Answering (MCQA)Question AnsweringA Semantic-based Method for Unsupervised Commonsense Question Answering
Unsupervised commonsense question answering is appealing since it does not rely on any labeled task data. Among existing work, a popular solution is to use pre-trained language models to score candidate choices directly …
Question AnsweringSemantic SimilaritySemantic Textual SimilaritySentenceTest-Time Reasoners Are Strategic Multiple-Choice Test-Takers
Large language models (LLMs) now give reasoning before answering, excelling in tasks like multiple-choice question answering (MCQA). Yet, a concern is that LLMs do not solve MCQs as intended, as work finds LLMs sans reas…
Question Answering