Shuffle Augmentation of Features from Unlabeled Data for Unsupervised Domain Adaptation
Unsupervised Domain Adaptation (UDA), a branch of transfer learning where labels for target samples are unavailable, has been widely researched and developed in recent years with the help of adversarially trained models. Although existing UDA algorithms are able to guide neural networks to extract transferable and discriminative features, classifiers are merely trained under the supervision of labeled source data. Given the inevitable discrepancy between source and target domains, the classifiers can hardly be aware of the target classification boundaries. In this paper, Shuffle Augmentation of Features (SAF), a novel UDA framework, is proposed to address the problem by providing the classifier with supervisory signals from target feature representations. SAF learns from the target samples, adaptively distills class-aware target features, and implicitly guides the classifier to find comprehensive class borders. Demonstrated by extensive experiments, the SAF module can be integrated into any existing adversarial UDA models to achieve performance improvements.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationTransfer LearningUnsupervised Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ShuffleMix: Improving Representations via Channel-Wise Shuffle of Interpolated Hidden States
Mixup style data augmentation algorithms have been widely adopted in various tasks as implicit network regularization on representation learning to improve model generalization, which can be achieved by a linear interpol…
BenchmarkingData AugmentationRepresentation LearningHierarchical Supervision and Shuffle Data Augmentation for 3D Semi-Supervised Object Detection
State-of-the-art 3D object detectors are usually trained on large-scale datasets with high-quality 3D annotations. However, such 3D annotations are often expensive and time-consuming, which may not be practical for real …
Data Augmentationobject-detectionObject DetectionSemi-Supervised Object DetectionAdversarial Feature Augmentation for Unsupervised Domain Adaptation
Recent works showed that Generative Adversarial Networks (GANs) can be successfully applied in unsupervised domain adaptation, where, given a labeled source dataset and an unlabeled target dataset, the goal is to train p…
Data AugmentationDomain AdaptationUnsupervised Domain AdaptationShuffle & Divide: Contrastive Learning for Long Text
We propose a self-supervised learning method for long text documents based on contrastive learning. A key to our method is Shuffle and Divide (SaD), a simple text augmentation algorithm that sets up a pretext task requir…
Contrastive LearningDocument EmbeddingSelf-Supervised LearningText Augmentation+3Unsupervised Data Augmentation with Naive Augmentation and without Unlabeled Data
Unsupervised Data Augmentation (UDA) is a semi-supervised technique that applies a consistency loss to penalize differences between a model's predictions on (a) observed (unlabeled) examples; and (b) corresponding 'noise…
Data Augmentationtext-classificationText ClassificationTranslation