Weakly Supervised Contrastive Adversarial Training for Learning Robust Features from Semi-supervised Data
Existing adversarial training (AT) methods often suffer from incomplete perturbation, meaning that not all non-robust features are perturbed when generating adversarial examples (AEs). This results in residual correlations between non-robust features and labels, leading to suboptimal learning of robust features. However, achieving complete perturbation, i.e., perturbing as many non-robust features as possible, is challenging due to the difficulty in distinguishing robust and non-robust features and the sparsity of labeled data. To address these challenges, we propose a novel approach called Weakly Supervised Contrastive Adversarial Training (WSCAT). WSCAT ensures complete perturbation for improved learning of robust features by disrupting correlations between non-robust features and labels through complete AE generation over partially labeled data, grounded in information theory. Extensive theoretical analysis and comprehensive experiments on widely adopted benchmarks validate the superiority of WSCAT.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Domain Adaptation for Semantic Segmentation via Patch-Wise Contrastive Learning
We introduce a novel approach to unsupervised and semi-supervised domain adaptation for semantic segmentation. Unlike many earlier methods that rely on adversarial learning for feature alignment, we leverage contrastive …
Contrastive LearningDomain AdaptationSegmentationSemantic Segmentation+1Deep Intra-Image Contrastive Learning for Weakly Supervised One-Step Person Search
Weakly supervised person search aims to perform joint pedestrian detection and re-identification (re-id) with only person bounding-box annotations. Recently, the idea of contrastive learning is initially applied to weakl…
Contrastive LearningPedestrian DetectionPerson SearchWeakly Supervised Contrastive Learning for Histopathology Patch Embeddings
Digital histopathology whole slide images (WSIs) provide gigapixel-scale high-resolution images that are highly useful for disease diagnosis. However, digital histopathology image analysis faces significant challenges du…
Multiple Instance LearningRepresentation LearningContrastive LearningWeakly Supervised Invariant Representation Learning Via Disentangling Known and Unknown Nuisance Factors
Disentangled and invariant representations are two critical goals of representation learning and many approaches have been proposed to achieve either one of them. However, those two goals are actually complementary to ea…
Adversarial DefenseRepresentation LearningSemi-weakly Supervised Contrastive Representation Learning for Retinal Fundus Images
We explore the value of weak labels in learning transferable representations for medical images. Compared to hand-labeled datasets, weak or inexact labels can be acquired in large quantities at significantly lower cost a…
Contrastive LearningRepresentation LearningTransfer Learning