Improving Adversarial Robustness via Unlabeled Out-of-Domain Data
Data augmentation by incorporating cheap unlabeled data from multiple domains is a powerful way to improve prediction especially when there is limited labeled data. In this work, we investigate how adversarial robustness can be enhanced by leveraging out-of-domain unlabeled data. We demonstrate that for broad classes of distributions and classifiers, there exists a sample complexity gap between standard and robust classification. We quantify to what degree this gap can be bridged via leveraging unlabeled samples from a shifted domain by providing both upper and lower bounds. Moreover, we show settings where we achieve better adversarial robustness when the unlabeled data come from a shifted domain rather than the same domain as the labeled data. We also investigate how to leverage out-of-domain data when some structural information, such as sparsity, is shared between labeled and unlabeled domains. Experimentally, we augment two object recognition datasets (CIFAR-10 and SVHN) with easy to obtain and unlabeled out-of-domain data and demonstrate substantial improvement in the model's robustness against $\ell_\infty$ adversarial attacks on the original domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial RobustnessData AugmentationObject RecognitionRobust classificationSimilar Papers 제목 키워드 기반
Adversarial Robustness for Unsupervised Domain Adaptation
Extensive Unsupervised Domain Adaptation (UDA) studies have shown great success in practice by learning transferable representations across a labeled source domain and an unlabeled target domain with deep models. However…
Adversarial RobustnessDomain AdaptationUnsupervised Domain AdaptationExploring Adversarially Robust Training for Unsupervised Domain Adaptation
Unsupervised Domain Adaptation (UDA) methods aim to transfer knowledge from a labeled source domain to an unlabeled target domain. UDA has been extensively studied in the computer vision literature. Deep networks have be…
Adversarial DefenseAdversarial RobustnessDomain AdaptationUnsupervised Domain AdaptationSRoUDA: Meta Self-training for Robust Unsupervised Domain Adaptation
As acquiring manual labels on data could be costly, unsupervised domain adaptation (UDA), which transfers knowledge learned from a rich-label dataset to the unlabeled target dataset, is gaining increasing popularity. Whi…
Adversarial RobustnessDomain AdaptationUnsupervised Domain AdaptationRobustified Domain Adaptation
Unsupervised domain adaptation (UDA) is widely used to transfer knowledge from a labeled source domain to an unlabeled target domain with different data distribution. While extensive studies attested that deep learning m…
Adversarial RobustnessDomain AdaptationUnsupervised Domain AdaptationDART: A Principled Approach to Adversarially Robust Unsupervised Domain Adaptation
Distribution shifts and adversarial examples are two major challenges for deploying machine learning models. While these challenges have been studied individually, their combination is an important topic that remains rel…
Adversarial RobustnessDomain AdaptationUnsupervised Domain Adaptation