paper-with-me

Papers

Improving Diversity with Adversarially Learned Transformations for Domain Generalization

2022-06-15 · Tejas Gokhale, Rushil Anirudh, Jayaraman J. Thiagarajan, Bhavya Kailkhura, Chitta Baral, Yezhou Yang

To be successful in single source domain generalization, maximizing diversity of synthesized domains has emerged as one of the most effective strategies. Many of the recent successes have come from methods that pre-specify the types of diversity that a model is exposed to during training, so that it can ultimately generalize well to new domains. However, na\"ive diversity based augmentations do not work effectively for domain generalization either because they cannot model large domain shift, or because the span of transforms that are pre-specified do not cover the types of shift commonly occurring in domain generalization. To address this issue, we present a novel framework that uses adversarially learned transformations (ALT) using a neural network to model plausible, yet hard image transformations that fool the classifier. This network is randomly initialized for each batch and trained for a fixed number of steps to maximize classification error. Further, we enforce consistency between the classifier's predictions on the clean and transformed images. With extensive empirical analysis, we find that this new form of adversarial transformations achieve both objectives of diversity and hardness simultaneously, outperforming all existing techniques on competitive benchmarks for single source domain generalization. We also show that ALT can naturally work with existing diversity modules to produce highly distinct, and large transformations of the source domain leading to state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2206.07736

Code (1)

tejas-gokhale/alt 공식 구현 pytorch

Tasks

DiversityDomain GeneralizationSingle-Source Domain Generalization

Similar Papers 제목 키워드 기반

AGAIN: Adversarial Training With Attribution Span Enlargement and Hybrid Feature Fusion

2023-01-01 · CVPR 2023 1 · Shenglin Yin, Kelu Yao, Sheng Shi, Yangzhou Du 외

The deep neural networks (DNNs) trained by adversarial training (AT) usually suffered from significant robust generalization gap, i.e., DNNs achieve high training robustness but low test robustness. In this paper, we…

Diversity

Causality-inspired Latent Feature Augmentation for Single Domain Generalization

2024-06-10 · Jian Xu, Chaojie Ji, Yankai Cao, Ye Li 외

Single domain generalization (Single-DG) intends to develop a generalizable model with only one single training domain to perform well on other unknown target domains. Under the domain-hungry configuration, how to expand…

Domain Generalization

Towards Robust Graph Contrastive Learning

2021-02-25 · Nikola Jovanović, Zhao Meng, Lukas Faber, Roger Wattenhofer

We study the problem of adversarially robust self-supervised learning on graphs. In the contrastive learning framework, we introduce a new method that increases the adversarial robustness of the learned representations t…

Adversarial RobustnessContrastive LearningSelf-Supervised Learning

Learning Canonical Transformations

2020-11-17 · Zachary Dulberg, Jonathan Cohen

Humans understand a set of canonical geometric transformations (such as translation and rotation) that support generalization by being untethered to any specific object. We explore inductive biases that help a neural net…

DiversityTranslation

ARMOURED: Adversarially Robust MOdels using Unlabeled data by REgularizing Diversity

2021-01-01 · ICLR 2021 1 · Kangkang Lu, Cuong Manh Nguyen, Xun Xu, Kiran Chari 외

Adversarial attacks pose a major challenge for modern deep neural networks. Recent advancements show that adversarially robust generalization requires a huge amount of labeled data for training. If annotation becomes a b…

DiversityMULTI-VIEW LEARNINGPoint Processes