Exploiting Style Transfer-based Task Augmentation for Cross-Domain Few-Shot Learning
In cross-domain few-shot learning, the core issue is that the model trained on source domains struggles to generalize to the target domain, especially when the domain shift is large. Motivated by the observation that the domain shift between training tasks and target tasks usually can reflect in their style variation, we propose Task Augmented Meta-Learning (TAML) to conduct style transfer-based task augmentation to improve the domain generalization ability. Firstly, Multi-task Interpolation (MTI) is introduced to fuse features from multiple tasks with different styles, which makes more diverse styles available. Furthermore, a novel task-augmentation strategy called Multi-Task Style Transfer (MTST) is proposed to perform style transfer on existing tasks to learn discriminative style-independent features. We also introduce a Feature Modulation module (FM) to add random styles and improve generalization of the model. The proposed TAML increases the diversity of styles of training tasks, and contributes to training a model with better domain generalization ability. The effectiveness is demonstrated via theoretical analysis and thorough experiments on two popular cross-domain few-shot benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Domain Few-Shotcross-domain few-shot learningDiversityDomain GeneralizationFew-Shot LearningMeta-LearningStyle TransferSimilar Papers 제목 키워드 기반
Exploiting Social Media Content for Self-Supervised Style Transfer
Recent research on style transfer takes inspiration from unsupervised neural machine translation (UNMT), learning from large amounts of non-parallel data by exploiting cycle consistency loss, back-translation, and denois…
AttributeDenoisingMachine TranslationNMT+2Style Augmentation: Data Augmentation via Style Randomization
We introduce style augmentation, a new form of data augmentation based on random style transfer, for improving the robustness of convolutional neural networks (CNN) over both classification and regression based tasks. Du…
ClassificationData AugmentationDepth EstimationDomain Adaptation+3STaDA: Style Transfer as Data Augmentation
The success of training deep Convolutional Neural Networks (CNNs) heavily depends on a significant amount of labelled data. Recent research has found that neural style transfer algorithms can apply the artistic style of …
ClassificationData AugmentationGeneral Classificationimage-classification+2Multi-Modality Microscopy Image Style Transfer for Nuclei Segmentation
Annotating microscopy images for nuclei segmentation is laborious and time-consuming. To leverage the few existing annotations, also across multiple modalities, we propose a novel microscopy-style augmentation technique …
Data AugmentationGenerative Adversarial NetworkSegmentationStyle TransferHow to augment your ViTs? Consistency loss and StyleAug, a random style transfer augmentation
The Vision Transformer (ViT) architecture has recently achieved competitive performance across a variety of computer vision tasks. One of the motivations behind ViTs is weaker inductive biases, when compared to convoluti…
Data Augmentationimage-classificationImage ClassificationStyle Transfer