Learning to Prompt Knowledge Transfer for Open-World Continual Learning
This paper studies the problem of continual learning in an open-world scenario, referred to as Open-world Continual Learning (OwCL). OwCL is increasingly rising while it is highly challenging in two-fold: i) learning a sequence of tasks without forgetting knowns in the past, and ii) identifying unknowns (novel objects/classes) in the future. Existing OwCL methods suffer from the adaptability of task-aware boundaries between knowns and unknowns, and do not consider the mechanism of knowledge transfer. In this work, we propose Pro-KT, a novel prompt-enhanced knowledge transfer model for OwCL. Pro-KT includes two key components: (1) a prompt bank to encode and transfer both task-generic and task-specific knowledge, and (2) a task-aware open-set boundary to identify unknowns in the new tasks. Experimental results using two real-world datasets demonstrate that the proposed Pro-KT outperforms the state-of-the-art counterparts in both the detection of unknowns and the classification of knowns markedly.
Code (1)
Tasks
Continual LearningTransfer LearningSimilar Papers 제목 키워드 기반
Continual Prompt Tuning for Dialog State Tracking
A desirable dialog system should be able to continually learn new skills without forgetting old ones, and thereby adapt to new domains or tasks in its life cycle. However, continually training a model often leads to a we…
Continual Learningdialog state trackingTransfer LearningContinual Prompt Tuning for Dialog State Tracking
A desirable dialog system should be able to continually learn new skills without forgetting old ones, and thereby adapt to new domains or tasks in its life cycle. However, continually training a model often leads to a we…
Continual Learningdialog state trackingTransfer LearningExploring Open-world Continual Learning with Knowns-Unknowns Knowledge Transfer
Open-World Continual Learning (OWCL) is a challenging paradigm where models must incrementally learn new knowledge without forgetting while operating under an open-world assumption. This requires handling incomplete trai…
Continual LearningTransfer LearningContinually Detection, Rapidly React: Unseen Rumors Detection Based on Continual Prompt-Tuning
Since open social platforms allow for a large and continuous flow of unverified information, rumors can emerge unexpectedly and spread quickly. However, existing rumor detection (RD) models often assume the same training…
Transfer LearningContinuous Detection, Rapidly React: Unseen Rumors Detection based on Continual Prompt-Tuning
Since open social platforms allow for a large and continuous flow of unverified information, rumors can emerge unexpectedly and spread quickly. However, existing rumor detection (RD) models often assume the same training…
Transfer Learning