When Video Classification Meets Incremental Classes
With the rapid development of social media, tremendous videos with new classes are generated daily, which raise an urgent demand for video classification methods that can continuously update new classes while maintaining the knowledge of old videos with limited storage and computing resources. In this paper, we summarize this task as Class-Incremental Video Classification (CIVC) and propose a novel framework to address it. As a subarea of incremental learning tasks, the challenge of catastrophic forgetting is unavoidable in CIVC. To better alleviate it, we utilize some characteristics of videos. First, we decompose the spatio-temporal knowledge before distillation rather than treating it as a whole in the knowledge transfer process; trajectory is also used to refine the decomposition. Second, we propose a dual granularity exemplar selection method to select and store representative video instances of old classes and key-frames inside videos under a tight storage budget. We benchmark our method and previous SOTA class-incremental learning methods on Something-Something V2 and Kinetics datasets, and our method outperforms previous methods significantly.
Code (0)
등록된 구현이 없습니다.
Tasks
Classificationclass-incremental learningClass Incremental LearningIncremental LearningTransfer LearningVideo ClassificationSimilar Papers 제목 키워드 기반
Class incremental learning for video action classification
Class Incremental Learning (CIL) is a hot topic in machine learning for CNN models to learn new classes incrementally. However, most of the CIL studies are for image classification and object recognition tasks and few CI…
Action ClassificationAction Recognition In VideosClassificationclass-incremental learning+6Active Learning for Online Recognition of Human Activities from Streaming Videos
Recognising human activities from streaming videos poses unique challenges to learning algorithms: predictive models need to be scalable, incrementally trainable, and must remain bounded in size even when the data stream…
Active LearningGeneralized and Incremental Few-Shot Learning by Explicit Learning and Calibration without Forgetting
Both generalized and incremental few-shot learning have to deal with three major challenges: learning novel classes from only few samples per class, preventing catastrophic forgetting of base classes, and classifier cali…
Classifier calibrationFew-Shot LearningFew-shot Class-incremental Audio Classification Using Stochastic Classifier
It is generally assumed that number of classes is fixed in current audio classification methods, and the model can recognize pregiven classes only. When new classes emerge, the model needs to be retrained with adequate s…
Audio ClassificationClassificationFew-shot Class-incremental Learning for Cross-domain Disease Classification
The ability to incrementally learn new classes from limited samples is crucial to the development of artificial intelligence systems for real clinical application. Although existing incremental learning techniques have a…
class-incremental learningClass Incremental LearningCross-Domain Few-ShotData Augmentation+2