paper-with-me

Papers

SRoUDA: Meta Self-training for Robust Unsupervised Domain Adaptation

2022-12-12 · Wanqing Zhu, Jia-Li Yin, Bo-Hao Chen, Ximeng Liu

As acquiring manual labels on data could be costly, unsupervised domain adaptation (UDA), which transfers knowledge learned from a rich-label dataset to the unlabeled target dataset, is gaining increasing popularity. While extensive studies have been devoted to improving the model accuracy on target domain, an important issue of model robustness is neglected. To make things worse, conventional adversarial training (AT) methods for improving model robustness are inapplicable under UDA scenario since they train models on adversarial examples that are generated by supervised loss function. In this paper, we present a new meta self-training pipeline, named SRoUDA, for improving adversarial robustness of UDA models. Based on self-training paradigm, SRoUDA starts with pre-training a source model by applying UDA baseline on source labeled data and taraget unlabeled data with a developed random masked augmentation (RMA), and then alternates between adversarial target model training on pseudo-labeled target data and finetuning source model by a meta step. While self-training allows the direct incorporation of AT in UDA, the meta step in SRoUDA further helps in mitigating error propagation from noisy pseudo labels. Extensive experiments on various benchmark datasets demonstrate the state-of-the-art performance of SRoUDA where it achieves significant model robustness improvement without harming clean accuracy. Code is available at https://github.com/Vision.

📄 PDF Abstract BibTeX arXiv:2212.05917

Code (1)

visionflow/srouda_main 공식 구현 pytorch

Tasks

Adversarial RobustnessDomain AdaptationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Unsupervised Domain Adaptation for Text Classification via Meta Self-Paced Learning

2022-10-01 · COLING 2022 10 · Nghia Ngo Trung, Linh Ngo Van, Thien Huu Nguyen

A shift in data distribution can have a significant impact on performance of a text classification model. Recent methods addressing unsupervised domain adaptation for textual tasks typically extracted domain-invariant re…

Domain AdaptationMeta-Learningtext-classificationText Classification+1

MSDA: Combining Pseudo-labeling and Self-Supervision for Unsupervised Domain Adaptation in ASR

2025-05-30 · Dimitrios Damianos, Georgios Paraskevopoulos, Alexandros Potamianos

In this work, we investigate the Meta PL unsupervised domain adaptation framework for Automatic Speech Recognition (ASR). We introduce a Multi-Stage Domain Adaptation pipeline (MSDA), a sample-efficient, two-stage adapta…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Domain AdaptationSelf-Supervised Learning+3

Self-Supervised Prototypical Transfer Learning for Few-Shot Classification

2020-06-19 · Carlos Medina, Arnout Devos, Matthias Grossglauser

Most approaches in few-shot learning rely on costly annotated data related to the goal task domain during (pre-)training. Recently, unsupervised meta-learning methods have exchanged the annotation requirement for a reduc…

ClassificationFew-Shot LearningGeneral ClassificationMeta-Learning+4

MetaAlign: Coordinating Domain Alignment and Classification for Unsupervised Domain Adaptation

2021-03-25 · CVPR 2021 1 · Guoqiang Wei, Cuiling Lan, Wenjun Zeng, Zhibo Chen

For unsupervised domain adaptation (UDA), to alleviate the effect of domain shift, many approaches align the source and target domains in the feature space by adversarial learning or by explicitly aligning their statisti…

ClassificationDomain AdaptationGeneral ClassificationMeta-Learning+4

Who Needs Labels? Adapting Vision Foundation Models With the Metadata You Already Have

2026-06-03 · Elouan Gardès, Seung Eun Yi, Kartik Ahuja, Théo Moutakanni 외 arxiv

We propose a label-free approach to adapt powerful but generic vision foundation models to specialized scientific domains. Standard supervised fine-tuning is often ill-suited to these settings: labels are scarce, and tas…

Unsupervised Domain Adaptation