paper-with-me

Papers

Exploring Open-world Continual Learning with Knowns-Unknowns Knowledge Transfer

2025-02-27 · Yujie Li, Guannan Lai, Xin Yang, Yonghao Li, Marcello Bonsangue, Tianrui Li

Open-World Continual Learning (OWCL) is a challenging paradigm where models must incrementally learn new knowledge without forgetting while operating under an open-world assumption. This requires handling incomplete training data and recognizing unknown samples during inference. However, existing OWCL methods often treat open detection and continual learning as separate tasks, limiting their ability to integrate open-set detection and incremental classification in OWCL. Moreover, current approaches primarily focus on transferring knowledge from known samples, neglecting the insights derived from unknown/open samples. To address these limitations, we formalize four distinct OWCL scenarios and conduct comprehensive empirical experiments to explore potential challenges in OWCL. Our findings reveal a significant interplay between the open detection of unknowns and incremental classification of knowns, challenging a widely held assumption that unknown detection and known classification are orthogonal processes. Building on our insights, we propose \textbf{HoliTrans} (Holistic Knowns-Unknowns Knowledge Transfer), a novel OWCL framework that integrates nonlinear random projection (NRP) to create a more linearly separable embedding space and distribution-aware prototypes (DAPs) to construct an adaptive knowledge space. Particularly, our HoliTrans effectively supports knowledge transfer for both known and unknown samples while dynamically updating representations of open samples during OWCL. Extensive experiments across various OWCL scenarios demonstrate that HoliTrans outperforms 22 competitive baselines, bridging the gap between OWCL theory and practice and providing a robust, scalable framework for advancing open-world learning paradigms.

📄 PDF Abstract BibTeX arXiv:2502.20124

Code (1)

aignlai/holitrans 공식 구현 pytorch

Tasks

Continual LearningTransfer Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Learning to Prompt Knowledge Transfer for Open-World Continual Learning

2023-12-22 · Yujie Li, Xin Yang, Hao Wang, Xiangkun Wang 외

This paper studies the problem of continual learning in an open-world scenario, referred to as Open-world Continual Learning (OwCL). OwCL is increasingly rising while it is highly challenging in two-fold: i) learning a s…

Continual LearningTransfer Learning

AI Autonomy : Self-Initiated Open-World Continual Learning and Adaptation

2022-03-17 · Bing Liu, Sahisnu Mazumder, Eric Robertson, Scott Grigsby

As more and more AI agents are used in practice, it is time to think about how to make these agents fully autonomous so that they can (1) learn by themselves continually in a self-motivated and self-initiated manner rath…

AI AgentContinual Learning

Self-Initiated Open World Learning for Autonomous AI Agents

2021-10-21 · Bing Liu, Eric Robertson, Scott Grigsby, Sahisnu Mazumder

As more and more AI agents are used in practice, it is time to think about how to make these agents fully autonomous so that they can learn by themselves in a self-motivated and self-supervised manner rather than being r…

AI Agent

Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration

2016-10-28 · Himabindu Lakkaraju, Ece Kamar, Rich Caruana, Eric Horvitz

Predictive models deployed in the real world may assign incorrect labels to instances with high confidence. Such errors or unknown unknowns are rooted in model incompleteness, and typically arise because of the mismatch …

Open-world Machine Learning: A Review and New Outlooks

2024-03-04 · Fei Zhu, Shijie Ma, Zhen Cheng, Xu-Yao Zhang 외

Machine learning has achieved remarkable success in many applications. However, existing studies are largely based on the closed-world assumption, which assumes that the environment is stationary, and the model is fixed …

class-incremental learningClass Incremental LearningIncremental LearningNovel Class Discovery