paper-with-me

Papers

Adaptive Aggregation Networks for Class-Incremental Learning

2020-10-10 · CVPR 2021 1 · Yaoyao Liu, Bernt Schiele, Qianru Sun

Class-Incremental Learning (CIL) aims to learn a classification model with the number of classes increasing phase-by-phase. An inherent problem in CIL is the stability-plasticity dilemma between the learning of old and new classes, i.e., high-plasticity models easily forget old classes, but high-stability models are weak to learn new classes. We alleviate this issue by proposing a novel network architecture called Adaptive Aggregation Networks (AANets), in which we explicitly build two types of residual blocks at each residual level (taking ResNet as the baseline architecture): a stable block and a plastic block. We aggregate the output feature maps from these two blocks and then feed the results to the next-level blocks. We adapt the aggregation weights in order to balance these two types of blocks, i.e., to balance stability and plasticity, dynamically. We conduct extensive experiments on three CIL benchmarks: CIFAR-100, ImageNet-Subset, and ImageNet, and show that many existing CIL methods can be straightforwardly incorporated into the architecture of AANets to boost their performances.

📄 PDF Abstract BibTeX arXiv:2010.05063

Code (2)

yaoyao-liu/class-incremental-learning 공식 구현 pytorch
yaoyao-liu/mnemonics pytorch

Tasks

class-incremental learningClass Incremental LearningIncremental Learning

Methods 이 논문이 사용한 방법론

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Average Pooling 설명 없음
Batch Normalization 설명 없음
Residual Connection 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…

Similar Papers 제목 키워드 기반

MLFCIL: A Multi-Level Forgetting Mitigation Framework for Federated Class-Incremental Learning in LEO Satellites

2026-03-14 · Heng Zhang, Xiaohong Deng, Sijing Duan, Wu Ouyang 외 arxiv

Low-Earth-orbit (LEO) satellite constellations are increasingly performing on-board computing. However, the continuous emergence of new classes under strict memory and communication constraints poses major challenges for…

class-incremental learningKnowledge Distillation

Improving Network Anomaly Detection via Choquet-Integral-Based Feature Aggregation

2026-07-16 · Abreu Quevedo, Roger Immich, Giancarlo Lucca, Graçaliz Dimuro 외 arxiv

This work investigates a generalized Choquet-integral-based feature aggregation framework to improve anomaly detection in high-dimensional network traffic data. The approach combines adaptive weighting with incremental f…

Intrusion DetectionAnomaly Detection

AREA: Attribute Extraction and Aggregation for CLIP-Based Class-Incremental Learning

2026-05-27 · Zhen-Hao Xie, Yu-Cheng Shi, Da-Wei Zhou arxiv

Class-Incremental Learning (CIL) is important in building real-world learning systems. In CLIP-based CIL, the model performs classification by comparing similarity between visual and textual embeddings obtained from temp…

class-incremental learningAttribute Extraction

Few-Shot Class-Incremental Learning via Class-Aware Bilateral Distillation

2023-01-01 · CVPR 2023 1 · Linglan Zhao, Jing Lu, Yunlu Xu, Zhanzhan Cheng 외

Few-Shot Class-Incremental Learning (FSCIL) aims to continually learn novel classes based on only few training samples, which poses a more challenging task than the well-studied Class-Incremental Learning (CIL) due t…

class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningGeneral Knowledge+3

On the Discrimination and Consistency for Exemplar-Free Class Incremental Learning

2025-01-26 · Tianqi Wang, Jingcai Guo, Depeng Li, Zhi Chen

Exemplar-free class incremental learning (EF-CIL) is a nontrivial task that requires continuously enriching model capability with new classes while maintaining previously learned knowledge without storing and replaying a…

class-incremental learningClass Incremental LearningExemplar-FreeIncremental Learning