CSSL-MHTR: Continual Self-Supervised Learning for Scalable Multi-script Handwritten Text Recognition
Self-supervised learning has recently emerged as a strong alternative in document analysis. These approaches are now capable of learning high-quality image representations and overcoming the limitations of supervised methods, which require a large amount of labeled data. However, these methods are unable to capture new knowledge in an incremental fashion, where data is presented to the model sequentially, which is closer to the realistic scenario. In this paper, we explore the potential of continual self-supervised learning to alleviate the catastrophic forgetting problem in handwritten text recognition, as an example of sequence recognition. Our method consists in adding intermediate layers called adapters for each task, and efficiently distilling knowledge from the previous model while learning the current task. Our proposed framework is efficient in both computation and memory complexity. To demonstrate its effectiveness, we evaluate our method by transferring the learned model to diverse text recognition downstream tasks, including Latin and non-Latin scripts. As far as we know, this is the first application of continual self-supervised learning for handwritten text recognition. We attain state-of-the-art performance on English, Italian and Russian scripts, whilst adding only a few parameters per task. The code and trained models will be publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual Self-Supervised LearningHandwritten Text RecognitionSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Concept Representation Learning with Contrastive Self-Supervised Learning
Concept-oriented deep learning (CODL) is a general approach to meet the future challenges for deep learning: (1) learning with little or no external supervision, (2) coping with test examples that come from a different d…
class-incremental learningClass Incremental LearningContinual LearningDeep Learning+4International Workshop on Continual Semi-Supervised Learning: Introduction, Benchmarks and Baselines
The aim of this paper is to formalize a new continual semi-supervised learning (CSSL) paradigm, proposed to the attention of the machine learning community via the IJCAI 2021 International Workshop on Continual Semi-Supe…
Activity RecognitionCrowd CountingExemplar-Based Contrastive Self-Supervised Learning with Few-Shot Class Incremental Learning
Humans are capable of learning new concepts from only a few (labeled) exemplars, incrementally and continually. This happens within the context that we can differentiate among the exemplars, and between the exemplars and…
class-incremental learningClass Incremental LearningData AugmentationFew-Shot Class-Incremental Learning+3Contrastive Continuity on Augmentation Stability Rehearsal for Continual Self-Supervised Learning
Self-supervised learning has attracted a lot of attention recently, which is able to learn powerful representations without any manual annotations. However, self-supervised learning needs to develop the ability to co…
Continual Self-Supervised LearningSelf-Supervised LearningOn the Effectiveness of Equivariant Regularization for Robust Online Continual Learning
Humans can learn incrementally, whereas neural networks forget previously acquired information catastrophically. Continual Learning (CL) approaches seek to bridge this gap by facilitating the transfer of knowledge to bot…
Continual LearningSelf-Supervised Learning