CSSL-RHA: Contrastive Self-Supervised Learning for Robust Handwriting Authentication
Handwriting authentication is a valuable tool used in various fields, such as fraud prevention and cultural heritage protection. However, it remains a challenging task due to the complex features, severe damage, and lack of supervision. In this paper, we propose a novel Contrastive Self-Supervised Learning framework for Robust Handwriting Authentication (CSSL-RHA) to address these issues. It can dynamically learn complex yet important features and accurately predict writer identities. Specifically, to remove the negative effects of imperfections and redundancy, we design an information-theoretic filter for pre-processing and propose a novel adaptive matching scheme to represent images as patches of local regions dominated by more important features. Through online optimization at inference time, the most informative patch embeddings are identified as the "most important" elements. Furthermore, we employ contrastive self-supervised training with a momentum-based paradigm to learn more general statistical structures of handwritten data without supervision. We conduct extensive experiments on five benchmark datasets and our manually annotated dataset EN-HA, which demonstrate the superiority of our CSSL-RHA compared to baselines. Additionally, we show that our proposed model can still effectively achieve authentication even under abnormal circumstances, such as data falsification and corruption.
Code (0)
등록된 구현이 없습니다.
Tasks
Self-Supervised LearningSimilar Papers 제목 키워드 기반
Image-based Freeform Handwriting Authentication with Energy-oriented Self-Supervised Learning
Freeform handwriting authentication verifies a person's identity from their writing style and habits in messy handwriting data. This technique has gained widespread attention in recent years as a valuable tool for variou…
Contrastive LearningSelf-Supervised LearningExemplar-Based Contrastive Self-Supervised Learning with Few-Shot Class Incremental Learning
Humans are capable of learning new concepts from only a few (labeled) exemplars, incrementally and continually. This happens within the context that we can differentiate among the exemplars, and between the exemplars and…
class-incremental learningClass Incremental LearningData AugmentationFew-Shot Class-Incremental Learning+3Concept Representation Learning with Contrastive Self-Supervised Learning
Concept-oriented deep learning (CODL) is a general approach to meet the future challenges for deep learning: (1) learning with little or no external supervision, (2) coping with test examples that come from a different d…
class-incremental learningClass Incremental LearningContinual LearningDeep Learning+4Contrastive Self-supervised Learning for Graph Classification
Graph classification is a widely studied problem and has broad applications. In many real-world problems, the number of labeled graphs available for training classification models is limited, which renders these models p…
ClassificationData AugmentationGeneral ClassificationGraph Classification+1C3-DINO: Joint Contrastive and Non-contrastive Self-Supervised Learning for Speaker Verification
Self-supervised learning (SSL) has drawn an increased attention in the field of speech processing. Recent studies have demonstrated that contrastive learning is able to learn discriminative speaker embeddings in a self-s…
Contrastive LearningSelf-Supervised LearningSpeaker Verification