BUCA: A Binary Classification Approach to Unsupervised Commonsense Question Answering
Unsupervised commonsense reasoning (UCR) is becoming increasingly popular as the construction of commonsense reasoning datasets is expensive, and they are inevitably limited in their scope. A popular approach to UCR is to fine-tune language models with external knowledge (e.g., knowledge graphs), but this usually requires a large number of training examples. In this paper, we propose to transform the downstream multiple choice question answering task into a simpler binary classification task by ranking all candidate answers according to their reasonableness. To this end, for training the model, we convert the knowledge graph triples into reasonable and unreasonable texts. Extensive experimental results show the effectiveness of our approach on various multiple choice question answering benchmarks. Furthermore, compared with existing UCR approaches using KGs, ours is less data hungry. Our code is available at https://github.com/probe2/BUCA.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationKnowledge GraphsMultiple-choiceQuestion AnsweringSimilar Papers 제목 키워드 기반
TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering
Unsupervised commonsense question answering requires mining effective commonsense knowledge without the rely on the labeled task data. Previous methods typically retrieved from traditional knowledge bases or used pre-tra…
Answer GenerationQuestion AnsweringVocal Bursts Valence PredictionTwo is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering
We propose a simple refactoring of multi-choice question answering (MCQA) tasks as a series of binary classifications. The MCQA task is generally performed by scoring each (question, answer) pair normalized over all the …
Binary ClassificationQuestion AnsweringScience Question AnsweringSentence+1ArT: All-round Thinker for Unsupervised Commonsense Question-Answering
Without labeled question-answer pairs for necessary training, unsupervised commonsense question-answering (QA) appears to be extremely challenging due to its indispensable unique prerequisite on commonsense source like k…
AllQuestion AnsweringArT: All-round Thinker for Unsupervised Commonsense Question Answering
Without labeled question-answer pairs for necessary training, unsupervised commonsense question-answering (QA) appears to be extremely challenging due to its indispensable unique prerequisite on commonsense source like k…
AllQuestion AnsweringA Semantic-based Method for Unsupervised Commonsense Question Answering
Unsupervised commonsense question answering is appealing since it does not rely on any labeled task data. Among existing work, a popular solution is to use pre-trained language models to score candidate choices directly …
Question AnsweringSemantic SimilaritySemantic Textual SimilaritySentence