Class-Incremental Few-Shot Event Detection

2024-04-02 · Kailin Zhao, Xiaolong Jin, Long Bai, Jiafeng Guo, Xueqi Cheng

Event detection is one of the fundamental tasks in information extraction and knowledge graph. However, a realistic event detection system often needs to deal with new event classes constantly. These new classes usually have only a few labeled instances as it is time-consuming and labor-intensive to annotate a large number of unlabeled instances. Therefore, this paper proposes a new task, called class-incremental few-shot event detection. Nevertheless, this task faces two problems, i.e., old knowledge forgetting and new class overfitting. To solve these problems, this paper further presents a novel knowledge distillation and prompt learning based method, called Prompt-KD. Specifically, to handle the forgetting problem about old knowledge, Prompt-KD develops an attention based multi-teacher knowledge distillation framework, where the ancestor teacher model pre-trained on base classes is reused in all learning sessions, and the father teacher model derives the current student model via adaptation. On the other hand, in order to cope with the few-shot learning scenario and alleviate the corresponding new class overfitting problem, Prompt-KD is also equipped with a prompt learning mechanism. Extensive experiments on two benchmark datasets, i.e., FewEvent and MAVEN, demonstrate the superior performance of Prompt-KD.

📄 PDF Abstract BibTeX arXiv:2404.01767

Code (0)

등록된 구현이 없습니다.

Tasks

Event DetectionFew-Shot Learning Knowledge DistillationPrompt Learning

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

BASE 설명 없음

Few-shot Incremental Event Detection

2022-09-05 · Hao Wang, Hanwen Shi, Jianyong Duan

Event detection tasks can enable the quick detection of events from texts and provide powerful support for downstream natural language processing tasks. Most such methods can only detect a fixed set of predefined event c…

Event Detection Incremental Learning

Incremental-DETR: Incremental Few-Shot Object Detection via Self-Supervised Learning

2022-05-09 · Na Dong, Yongqiang Zhang, Mingli Ding, Gim Hee Lee

Incremental few-shot object detection aims at detecting novel classes without forgetting knowledge of the base classes with only a few labeled training data from the novel classes. Most related prior works are on increme…

Few-Shot Object Detection Knowledge Distillation Object object-detection+2

Few-Shot Batch Incremental Road Object Detection via Detector Fusion

2021-08-18 · Anuj Tambwekar, Kshitij Agrawal, Anay Majee, Anbumani Subramanian

Incremental few-shot learning has emerged as a new and challenging area in deep learning, whose objective is to train deep learning models using very few samples of new class data, and none of the old class data. In this…

Few-Shot Learning object-detection Object Detection

Generalized and Incremental Few-Shot Learning by Explicit Learning and Calibration without Forgetting

2021-08-18 · ICCV 2021 10 · Anna Kukleva, Hilde Kuehne, Bernt Schiele

Both generalized and incremental few-shot learning have to deal with three major challenges: learning novel classes from only few samples per class, preventing catastrophic forgetting of base classes, and classifier cali…

Classifier calibration Few-Shot Learning

Towards Generalized and Incremental Few-Shot Object Detection

2021-09-23 · Yiting Li, Haiyue Zhu, Jun Ma, Chek Sing Teo 외

Real-world object detection is highly desired to be equipped with the learning expandability that can enlarge its detection classes incrementally. Moreover, such learning from only few annotated training samples further …

Autonomous Driving Continual Learning Few-Shot Learning Few-Shot Object Detection+3