paper-with-me

Papers

A Classifier-Free Incremental Learning Framework for Scalable Medical Image Segmentation

2024-05-25 · Xiaoyang Chen, Hao Zheng, Yifang Xie, Yuncong Ma, Tengfei Li

Current methods for developing foundation models in medical image segmentation rely on two primary assumptions: a fixed set of classes and the immediate availability of a substantial and diverse training dataset. However, this can be impractical due to the evolving nature of imaging technology and patient demographics, as well as labor-intensive data curation, limiting their practical applicability and scalability. To address these challenges, we introduce a novel segmentation paradigm enabling the segmentation of a variable number of classes within a single classifier-free network, featuring an architecture independent of class number. This network is trained using contrastive learning and produces discriminative feature representations that facilitate straightforward interpretation. Additionally, we integrate this strategy into a knowledge distillation-based incremental learning framework, facilitating the gradual assimilation of new information from non-stationary data streams while avoiding catastrophic forgetting. Our approach provides a unified solution for tackling both class- and domain-incremental learning scenarios. We demonstrate the flexibility of our method in handling varying class numbers within a unified network and its capacity for incremental learning. Experimental results on an incompletely annotated, multi-modal, multi-source dataset for medical image segmentation underscore its superiority over state-of-the-art alternative approaches.

📄 PDF Abstract BibTeX arXiv:2405.16328

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningImage SegmentationIncremental LearningKnowledge DistillationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Scalable Analytic Classifiers with Associative Drift Compensation for Class-Incremental Learning of Vision Transformers

2026-01-29 · Xuan Rao, Mingming Ha, Bo Zhao, Derong Liu 외 arxiv

Class-incremental learning (CIL) with Vision Transformers (ViTs) faces a major computational bottleneck during the classifier reconstruction phase, where most existing methods rely on costly iterative stochastic gradient…

class-incremental learning

Scalable Class-Incremental Learning Based on Parametric Neural Collapse

2025-12-26 · Chuangxin Zhang, Guangfeng Lin, Enhui Zhao, Kaiyang Liao 외 arxiv

Incremental learning often encounter challenges such as overfitting to new data and catastrophic forgetting of old data. Existing methods can effectively extend the model for new tasks while freezing the parameters of th…

class-incremental learningClass Incremental LearningKnowledge Distillation

iKAN: Global Incremental Learning with KAN for Human Activity Recognition Across Heterogeneous Datasets

2024-06-03 · Mengxi Liu, Sizhen Bian, Bo Zhou, Paul Lukowicz

This work proposes an incremental learning (IL) framework for wearable sensor human activity recognition (HAR) that tackles two challenges simultaneously: catastrophic forgetting and non-uniform inputs. The scalable fram…

Activity RecognitionContinual LearningHuman Activity RecognitionIncremental Learning+1

Exemplar-free Class Incremental Learning via Discriminative and Comparable One-class Classifiers

2022-01-05 · Wenju Sun, Qingyong Li, Jing Zhang, Danyu Wang 외

The exemplar-free class incremental learning requires classification models to learn new class knowledge incrementally without retaining any old samples. Recently, the framework based on parallel one-class classifiers (P…

class-incremental learningClass Incremental LearningExemplar-FreeExemplar-Free Counting+2

Exemplar-Free Class Incremental Learning via Incremental Representation

2024-03-24 · Libo Huang, Zhulin An, Yan Zeng, Chuanguang Yang 외

Exemplar-Free Class Incremental Learning (efCIL) aims to continuously incorporate the knowledge from new classes while retaining previously learned information, without storing any old-class exemplars (i.e., samples). Fo…

class-incremental learningClass Incremental LearningExemplar-FreeIncremental Learning