Enhancing Question Generation with Commonsense Knowledge
Question generation (QG) is to generate natural and grammatical questions that can be answered by a specific answer for a given context. Previous sequence-to-sequence models suffer from a problem that asking high-quality questions requires commonsense knowledge as backgrounds, which in most cases can not be learned directly from training data, resulting in unsatisfactory questions deprived of knowledge. In this paper, we propose a multi-task learning framework to introduce commonsense knowledge into question generation process. We first retrieve relevant commonsense knowledge triples from mature databases and select triples with the conversion information from source context to question. Based on these informative knowledge triples, we design two auxiliary tasks to incorporate commonsense knowledge into the main QG model, where one task is Concept Relation Classification and the other is Tail Concept Generation. Experimental results on SQuAD show that our proposed methods are able to noticeably improve the QG performance on both automatic and human evaluation metrics, demonstrating that incorporating external commonsense knowledge with multi-task learning can help the model generate human-like and high-quality questions.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Task LearningQuestion GenerationQuestion-GenerationRelation ClassificationSimilar Papers 제목 키워드 기반
Multi-hop Commonsense Knowledge Injection Framework for Zero-Shot Commonsense Question Answering
Commonsense question answering (QA) research requires machines to answer questions based on commonsense knowledge. However, this research requires expensive labor costs to annotate data as the basis of research, and mode…
Contrastive LearningKnowledge GraphsQuestion AnsweringTSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering
Unsupervised commonsense question answering requires mining effective commonsense knowledge without the rely on the labeled task data. Previous methods typically retrieved from traditional knowledge bases or used pre-tra…
Answer GenerationQuestion AnsweringVocal Bursts Valence PredictionUFO: Unified Fact Obtaining for Commonsense Question Answering
Leveraging external knowledge to enhance the reasoning ability is crucial for commonsense question answering. However, the existing knowledge bases heavily rely on manual annotation which unavoidably causes deficiency in…
Fact SelectionQuestion AnsweringRetrievalQuestions beyond Pixels: Integrating Commonsense Knowledge in Visual Question Generation for Remote Sensing
With the rapid development of remote sensing image archives, asking questions about images has become an effective way of gathering specific information or performing semantic image retrieval. However, current automatica…
Question GenerationQuestion AnsweringImage CaptioningImage RetrievalCaseEdit: Enhancing Localized Commonsense Reasoning via Null-Space Constrained Knowledge Editing in Small Parameter Language Models
Large language models (LLMs) exhibit strong performance on factual recall and general reasoning but struggle to adapt to user-specific, commonsense knowledge, a challenge particularly acute in small-parameter settings wh…
Common Sense ReasoningComputational Efficiencyknowledge editing