paper-with-me

홈 › Papers

Self-Training with Dynamic Weighting for Robust Gradual Domain Adaptation

2025-10-13 · Zixi Wang, Yushe Cao, Yubo Huang, Jinzhu Wei, Jingzehua Xu, Shuai Zhang, Xin Lai arxiv

In this paper, we propose a new method called Self-Training with Dynamic Weighting (STDW), which aims to enhance robustness in Gradual Domain Adaptation (GDA) by addressing the challenge of smooth knowledge migration from the source to the target domain. Traditional GDA methods mitigate domain shift through intermediate domains and self-training but often suffer from inefficient knowledge migration or incomplete intermediate data. Our approach introduces a dynamic weighting mechanism that adaptively balances the loss contributions of the source and target domains during training. Specifically, we design an optimization framework governed by a time-varying hyperparameter $\varrho$ (progressing from 0 to 1), which controls the strength of domain-specific learning and ensures stable adaptation. The method leverages self-training to generate pseudo-labels and optimizes a weighted objective function for iterative model updates, maintaining robustness across intermediate domains. Experiments on rotated MNIST, color-shifted MNIST, portrait datasets, and the Cover Type dataset demonstrate that STDW outperforms existing baselines. Ablation studies further validate the critical role of $\varrho$'s dynamic scheduling in achieving progressive adaptation, confirming its effectiveness in reducing domain bias and improving generalization. This work provides both theoretical insights and a practical framework for robust gradual domain adaptation, with potential applications in dynamic real-world scenarios. The code is available at https://github.com/Dramwig/STDW.

📄 PDF Abstract BibTeX arXiv:2510.13864

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationRotated MNIST

Similar Papers 제목 키워드 기반

GDO: Gradual Domain Osmosis

2025-01-31 · Zixi Wang, Yubo Huang

In this paper, we propose a new method called Gradual Domain Osmosis, which aims to solve the problem of smooth knowledge migration from source domain to target domain in Gradual Domain Adaptation (GDA). Traditional Grad…

Domain AdaptationRotated MNIST

Understanding Self-Training for Gradual Domain Adaptation

2020-02-26 · ICML 2020 1 · Ananya Kumar, Tengyu Ma, Percy Liang

Machine learning systems must adapt to data distributions that evolve over time, in applications ranging from sensor networks and self-driving car perception modules to brain-machine interfaces. We consider gradual domai…

Domain AdaptationUnsupervised Domain Adaptation

HydaLearn: Highly Dynamic Task Weighting for Multi-task Learning with Auxiliary Tasks

2020-08-26 · Sam Verboven, Muhammad Hafeez Chaudhary, Jeroen Berrevoets, Wouter Verbeke

Multi-task learning (MTL) can improve performance on a task by sharing representations with one or more related auxiliary-tasks. Usually, MTL-networks are trained on a composite loss function formed by a constant weighte…

Multi-Task Learning

Introducing Intermediate Domains for Effective Self-Training during Test-Time

2022-08-16 · Robert A. Marsden, Mario Döbler, Bin Yang

Experiencing domain shifts during test-time is nearly inevitable in practice and likely results in a severe performance degradation. To overcome this issue, test-time adaptation continues to update the initial source mod…

Domain AdaptationScene SegmentationStyle TransferTest-time Adaptation+1

Adversarial Self-Training Improves Robustness and Generalization for Gradual Domain Adaptation

2023-09-21 · NeurIPS 2023 11

Gradual Domain Adaptation (GDA), in which the learner is provided with additional intermediate domains, has been theoretically and empirically studied in many contexts. Despite its vital role in security-critical scenari…