Class-Incremental Learning for Action Recognition in Videos
We tackle catastrophic forgetting problem in the context of class-incremental learning for video recognition, which has not been explored actively despite the popularity of continual learning. Our framework addresses this challenging task by introducing time-channel importance maps and exploiting the importance maps for learning the representations of incoming examples via knowledge distillation. We also incorporate a regularization scheme in our objective function, which encourages individual features obtained from different time steps in a video to be uncorrelated and eventually improves accuracy by alleviating catastrophic forgetting. We evaluate the proposed approach on brand-new splits of class-incremental action recognition benchmarks constructed upon the UCF101, HMDB51, and Something-Something V2 datasets, and demonstrate the effectiveness of our algorithm in comparison to the existing continual learning methods that are originally designed for image data.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionAction Recognition In Videosclass-incremental learningClass Incremental LearningContinual LearningIncremental LearningKnowledge DistillationVideo RecognitionSimilar Papers 제목 키워드 기반
Active Learning for Online Recognition of Human Activities from Streaming Videos
Recognising human activities from streaming videos poses unique challenges to learning algorithms: predictive models need to be scalable, incrementally trainable, and must remain bounded in size even when the data stream…
Active LearningIncremental Activity Modeling and Recognition in Streaming Videos
Most of the state-of-the-art approaches to human activity recognition in video need an intensive training stage and assume that all of the training examples are labeled and available beforehand. But these assumptions are…
Active LearningActivity RecognitionHuman Activity RecognitionLearning a Condensed Frame for Memory-Efficient Video Class-Incremental Learning
Recent incremental learning for action recognition usually stores representative videos to mitigate catastrophic forgetting. However, only a few bulky videos can be stored due to the limited memory. To address this probl…
Action Recognitionclass-incremental learningClass Incremental LearningIncremental LearningOnline Action Recognition based on Incremental Learning of Weighted Covariance Descriptors
Different from traditional action recognition based on video segments, online action recognition aims to recognize actions from unsegmented streams of data in a continuous manner. One way for online recognition is based …
Action RecognitionIncremental LearningTemporal Action LocalizationIncremental Boosting Convolutional Neural Network for Facial Action Unit Recognition
Recognizing facial action units (AUs) from spontaneous facial expressions is still a challenging problem. Most recently, CNNs have shown promise on facial AU recognition. However, the learned CNNs are often overfitted an…
Facial Action Unit DetectionIncremental Learning