paper-with-me

홈 › Papers

Recent Advances of Continual Learning in Computer Vision: An Overview

2021-09-23 · Haoxuan Qu, Hossein Rahmani, Li Xu, Bryan Williams, Jun Liu

In contrast to batch learning where all training data is available at once, continual learning represents a family of methods that accumulate knowledge and learn continuously with data available in sequential order. Similar to the human learning process with the ability of learning, fusing, and accumulating new knowledge coming at different time steps, continual learning is considered to have high practical significance. Hence, continual learning has been studied in various artificial intelligence tasks. In this paper, we present a comprehensive review of the recent progress of continual learning in computer vision. In particular, the works are grouped by their representative techniques, including regularization, knowledge distillation, memory, generative replay, parameter isolation, and a combination of the above techniques. For each category of these techniques, both its characteristics and applications in computer vision are presented. At the end of this overview, several subareas, where continuous knowledge accumulation is potentially helpful while continual learning has not been well studied, are discussed.

📄 PDF Abstract BibTeX arXiv:2109.11369

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningKnowledge Distillation

Similar Papers 제목 키워드 기반

A Survey on Recent Advances of Computer Vision Algorithms for Egocentric Video

2015-01-12 · Sven Bambach

Recent technological advances have made lightweight, head mounted cameras both practical and affordable and products like Google Glass show first approaches to introduce the idea of egocentric (first-person) video to the…

Action DetectionActivity DetectionObject RecognitionVideo Summarization

An Overview of Multi-Task Learning in Deep Neural Networks

2017-06-15 · Sebastian Ruder

Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general …

BIG-bench Machine LearningDrug DiscoveryMulti-Task Learningspeech-recognition+1

Meta-attention for ViT-backed Continual Learning

2022-03-22 · CVPR 2022 1 · Mengqi Xue, Haofei Zhang, Jie Song, Mingli Song

Continual learning is a longstanding research topic due to its crucial role in tackling continually arriving tasks. Up to now, the study of continual learning in computer vision is mainly restricted to convolutional neur…

Continual Learning

A Survey on Eye-Gaze Tracking Techniques

2013-12-22 · H. R. Chennamma, Xiaohui Yuan

Study of eye-movement is being employed in Human Computer Interaction (HCI) research. Eye - gaze tracking is one of the most challenging problems in the area of computer vision. The goal of this paper is to present a rev…

Survey

Recent Advances in Deep Learning: An Overview

2018-07-21 · Matiur Rahman Minar, Jibon Naher

Deep Learning is one of the newest trends in Machine Learning and Artificial Intelligence research. It is also one of the most popular scientific research trends now-a-days. Deep learning methods have brought revolutiona…

BIG-bench Machine LearningDeep Learning