Incremental Knowledge Based Question Answering
In the past years, Knowledge-Based Question Answering (KBQA), which aims to answer natural language questions using facts in a knowledge base, has been well developed. Existing approaches often assume a static knowledge base. However, the knowledge is evolving over time in the real world. If we directly apply a fine-tuning strategy on an evolving knowledge base, it will suffer from a serious catastrophic forgetting problem. In this paper, we propose a new incremental KBQA learning framework that can progressively expand learning capacity as humans do. Specifically, it comprises a margin-distilled loss and a collaborative exemplar selection method, to overcome the catastrophic forgetting problem by taking advantage of knowledge distillation. We reorganize the SimpleQuestion dataset to evaluate the proposed incremental learning solution to KBQA. The comprehensive experiments demonstrate its effectiveness and efficiency when working with the evolving knowledge base.
Code (0)
등록된 구현이 없습니다.
Tasks
Incremental LearningKnowledge DistillationQuestion AnsweringSimilar Papers 제목 키워드 기반
Incremental Reading for Question Answering
Any system which performs goal-directed continual learning must not only learn incrementally but process and absorb information incrementally. Such a system also has to understand when its goals have been achieved. In th…
Continual LearningQuestion AnsweringQuizbowl: The Case for Incremental Question Answering
Scholastic trivia competitions test knowledge and intelligence through mastery of question answering. Modern question answering benchmarks are one variant of the Turing test. Specifically, answering a set of questions as…
BIG-bench Machine LearningDecision MakingQuestion AnsweringSequential Decision MakingTask Formulation Matters When Learning Continuously: A Case Study in Visual Question Answering
Continual learning is a promising alternative to the current pretrain-and-finetune paradigm: It aims to learn a model on a sequence of tasks without forgetting knowledge from preceding tasks. We investigate continual lea…
Continual LearningIncremental LearningQuestion AnsweringSemantic Similarity+3Mining Object Parts from CNNs via Active Question-Answering
Given a convolutional neural network (CNN) that is pre-trained for object classification, this paper proposes to use active question-answering to semanticize neural patterns in conv-layers of the CNN and mine part concep…
Active LearningObjectQuestion AnsweringKBQA-o1: Agentic Knowledge Base Question Answering with Monte Carlo Tree Search
Knowledge Base Question Answering (KBQA) aims to answer natural language questions with a large-scale structured knowledge base (KB). Despite advancements with large language models (LLMs), KBQA still faces challenges in…
Heuristic SearchKnowledge Base Question AnsweringQuestion Answering