CrossTrainer: Practical Domain Adaptation with Loss Reweighting
Domain adaptation provides a powerful set of model training techniques given domain-specific training data and supplemental data with unknown relevance. The techniques are useful when users need to develop models with data from varying sources, of varying quality, or from different time ranges. We build CrossTrainer, a system for practical domain adaptation. CrossTrainer utilizes loss reweighting, which provides consistently high model accuracy across a variety of datasets in our empirical analysis. However, loss reweighting is sensitive to the choice of a weight hyperparameter that is expensive to tune. We develop optimizations leveraging unique properties of loss reweighting that allow CrossTrainer to output accurate models while improving training time compared to naive hyperparameter search.
Code (1)
Tasks
Domain AdaptationSimilar Papers 제목 키워드 기반
Adversarial Reweighting with $α$-Power Maximization for Domain Adaptation
The practical Domain Adaptation (DA) tasks, e.g., Partial DA (PDA), open-set DA, universal DA, and test-time adaptation, have gained increasing attention in the machine learning community. In this paper, we propose a nov…
Domain AdaptationTest-time AdaptationAdversarial Reweighting for Partial Domain Adaptation
Partial domain adaptation (PDA) has gained much attention due to its practical setting. The current PDA methods usually adapt the feature extractor by aligning the target and reweighted source domain distributions. In th…
Domain AdaptationPartial Domain AdaptationGuiding Pseudo-labels with Uncertainty Estimation for Source-free Unsupervised Domain Adaptation
Standard Unsupervised Domain Adaptation (UDA) methods assume the availability of both source and target data during the adaptation. In this work, we investigate Source-free Unsupervised Domain Adaptation (SF-UDA), a spec…
Domain AdaptationSource-Free Domain AdaptationUnsupervised Domain AdaptationUBR$^2$S: Uncertainty-Based Resampling and Reweighting Strategy for Unsupervised Domain Adaptation
Unsupervised domain adaptation (UDA) deals with the adaptation process of a model to an unlabeled target domain while annotated data is only available for a given source domain. This poses a challenging task, as the doma…
Domain AdaptationUnsupervised Domain AdaptationAdaptation Algorithm and Theory Based on Generalized Discrepancy
We present a new algorithm for domain adaptation improving upon a discrepancy minimization algorithm previously shown to outperform a number of algorithms for this task. Unlike many previous algorithms for domain adaptat…
Domain Adaptation