paper-with-me

홈 › Papers

Controllable Relation Disentanglement for Few-Shot Class-Incremental Learning

2024-03-17 · Yuan Zhou, Richang Hong, Yanrong Guo, Lin Liu, Shijie Hao, Hanwang Zhang

In this paper, we propose to tackle Few-Shot Class-Incremental Learning (FSCIL) from a new perspective, i.e., relation disentanglement, which means enhancing FSCIL via disentangling spurious relation between categories. The challenge of disentangling spurious correlations lies in the poor controllability of FSCIL. On one hand, an FSCIL model is required to be trained in an incremental manner and thus it is very hard to directly control relationships between categories of different sessions. On the other hand, training samples per novel category are only in the few-shot setting, which increases the difficulty of alleviating spurious relation issues as well. To overcome this challenge, in this paper, we propose a new simple-yet-effective method, called ConTrollable Relation-disentangLed Few-Shot Class-Incremental Learning (CTRL-FSCIL). Specifically, during the base session, we propose to anchor base category embeddings in feature space and construct disentanglement proxies to bridge gaps between the learning for category representations in different sessions, thereby making category relation controllable. During incremental learning, the parameters of the backbone network are frozen in order to relieve the negative impact of data scarcity. Moreover, a disentanglement loss is designed to effectively guide a relation disentanglement controller to disentangle spurious correlations between the embeddings encoded by the backbone. In this way, the spurious correlation issue in FSCIL can be suppressed. Extensive experiments on CIFAR-100, mini-ImageNet, and CUB-200 datasets demonstrate the effectiveness of our CTRL-FSCIL method.

📄 PDF Abstract BibTeX arXiv:2403.11070

Code (0)

등록된 구현이 없습니다.

Tasks

class-incremental learningClass Incremental LearningDisentanglementFew-Shot Class-Incremental LearningIncremental LearningRelation

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Non-generative Generalized Zero-shot Learning via Task-correlated Disentanglement and Controllable Samples Synthesis

2022-03-10 · CVPR 2022 1 · Yaogong Feng, Xiaowen Huang, Pengbo Yang, Jian Yu 외

Synthesizing pseudo samples is currently the most effective way to solve the Generalized Zero-Shot Learning (GZSL) problem. Most models achieve competitive performance but still suffer from two problems: (1) Feature conf…

DisentanglementDomain AdaptationGeneralized Zero-Shot LearningZero-Shot Learning

Incremental Disentanglement for Environment-Aware Zero-Shot Text-to-Speech Synthesis

2024-12-22 · Ye-Xin Lu, Hui-Peng Du, Zheng-Yan Sheng, Yang Ai 외

This paper proposes an Incremental Disentanglement-based Environment-Aware zero-shot text-to-speech (TTS) method, dubbed IDEA-TTS, that can synthesize speech for unseen speakers while preserving the acoustic characterist…

DecoderDisentanglementSpeech Synthesistext-to-speech+2

Encouraging Disentangled and Convex Representation with Controllable Interpolation Regularization

2021-12-06 · Yunhao Ge, Zhi Xu, Yao Xiao, Gan Xin 외

We focus on controllable disentangled representation learning (C-Dis-RL), where users can control the partition of the disentangled latent space to factorize dataset attributes (concepts) for downstream tasks. Two genera…

Data AugmentationDisentanglementFairnessImage Generation+1

GCVAE: Generalized-Controllable Variational AutoEncoder

2022-06-09 · Kenneth Ezukwoke, Anis Hoayek, Mireille Batton-Hubert, Xavier Boucher

Variational autoencoders (VAEs) have recently been used for unsupervised disentanglement learning of complex density distributions. Numerous variants exist to encourage disentanglement in latent space while improving rec…

Disentanglement

Learning Yourself: Class-Incremental Semantic Segmentation with Language-Inspired Bootstrapped Disentanglement

2025-08-30 · Ruitao Wu, Yifan Zhao, Jia Li arxiv

Class-Incremental Semantic Segmentation (CISS) requires continuous learning of newly introduced classes while retaining knowledge of past classes. By abstracting mainstream methods into two stages (visual feature extract…

Semantic Segmentation