Recent Advances of Continual Learning in Computer Vision: An Overview
In contrast to batch learning where all training data is available at once, continual learning represents a family of methods that accumulate knowledge and learn continuously with data available in sequential order. Similar to the human learning process with the ability of learning, fusing, and accumulating new knowledge coming at different time steps, continual learning is considered to have high practical significance. Hence, continual learning has been studied in various artificial intelligence tasks. In this paper, we present a comprehensive review of the recent progress of continual learning in computer vision. In particular, the works are grouped by their representative techniques, including regularization, knowledge distillation, memory, generative replay, parameter isolation, and a combination of the above techniques. For each category of these techniques, both its characteristics and applications in computer vision are presented. At the end of this overview, several subareas, where continuous knowledge accumulation is potentially helpful while continual learning has not been well studied, are discussed.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningKnowledge DistillationSimilar Papers 제목 키워드 기반
A Survey on Recent Advances of Computer Vision Algorithms for Egocentric Video
Recent technological advances have made lightweight, head mounted cameras both practical and affordable and products like Google Glass show first approaches to introduce the idea of egocentric (first-person) video to the…
Action DetectionActivity DetectionObject RecognitionVideo SummarizationAn Overview of Multi-Task Learning in Deep Neural Networks
Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general …
BIG-bench Machine LearningDrug DiscoveryMulti-Task Learningspeech-recognition+1Meta-attention for ViT-backed Continual Learning
Continual learning is a longstanding research topic due to its crucial role in tackling continually arriving tasks. Up to now, the study of continual learning in computer vision is mainly restricted to convolutional neur…
Continual LearningA Survey on Eye-Gaze Tracking Techniques
Study of eye-movement is being employed in Human Computer Interaction (HCI) research. Eye - gaze tracking is one of the most challenging problems in the area of computer vision. The goal of this paper is to present a rev…
SurveyRecent Advances in Deep Learning: An Overview
Deep Learning is one of the newest trends in Machine Learning and Artificial Intelligence research. It is also one of the most popular scientific research trends now-a-days. Deep learning methods have brought revolutiona…
BIG-bench Machine LearningDeep Learning