Target-Aware Generative Augmentations for Single-Shot Adaptation
In this paper, we address the problem of adapting models from a source domain to a target domain, a task that has become increasingly important due to the brittle generalization of deep neural networks. While several test-time adaptation techniques have emerged, they typically rely on synthetic toolbox data augmentations in cases of limited target data availability. We consider the challenging setting of single-shot adaptation and explore the design of augmentation strategies. We argue that augmentations utilized by existing methods are insufficient to handle large distribution shifts, and hence propose a new approach SiSTA, which first fine-tunes a generative model from the source domain using a single-shot target, and then employs novel sampling strategies for curating synthetic target data. Using experiments on a variety of benchmarks, distribution shifts and image corruptions, we find that SiSTA produces significantly improved generalization over existing baselines in face attribute detection and multi-class object recognition. Furthermore, SiSTA performs competitively to models obtained by training on larger target datasets. Our codes can be accessed at https://github.com/Rakshith-2905/SiSTA.
Code (1)
Tasks
AttributeObject RecognitionTest-time AdaptationSimilar Papers 제목 키워드 기반
Single-Shot Domain Adaptation via Target-Aware Generative Augmentation
The problem of adapting models from a source domain using data from any target domain of interest has gained prominence, thanks to the brittle generalization in deep neural networks. While several test-time adaptation te…
AttributeDomain AdaptationTest-time AdaptationBeyond Cropping and Rotation: Automated Evolution of Powerful Task-Specific Augmentations with Generative Models
Data augmentation has long been a cornerstone for reducing overfitting in vision models, with methods like AutoAugment automating the design of task-specific augmentations. Recent advances in generative models, such as c…
Image AugmentationFew-Shot LearningData AugmentationDomain Adaptation with a Single Vision-Language Embedding
Domain adaptation has been extensively investigated in computer vision but still requires access to target data at the training time, which might be difficult to obtain in some uncommon conditions. In this paper, we pres…
Domain AdaptationOne-shot Unsupervised Domain AdaptationSemantic SegmentationUnsupervised Domain AdaptationReX-Shot: Single-Image Rephotography via Geometry- and Camera-Grounded Generation
Single-image rephotography aims to synthesize new shots of a scene from a single reference image with specified viewpoints, focal lengths, and photographic effects, which are intrinsically coupled in imaging. Existing me…
3D ReconstructionAn Analysis of Model Robustness across Concurrent Distribution Shifts
Machine learning models, meticulously optimized for source data, often fail to predict target data when faced with distribution shifts (DSs). Previous benchmarking studies, though extensive, have mainly focused on simple…
Benchmarking