Energy-constrained Self-training for Unsupervised Domain Adaptation
Unsupervised domain adaptation (UDA) aims to transfer the knowledge on a labeled source domain distribution to perform well on an unlabeled target domain. Recently, the deep self-training involves an iterative process of predicting on the target domain and then taking the confident predictions as hard pseudo-labels for retraining. However, the pseudo-labels are usually unreliable, and easily leading to deviated solutions with propagated errors. In this paper, we resort to the energy-based model and constrain the training of the unlabeled target sample with the energy function minimization objective. It can be applied as a simple additional regularization. In this framework, it is possible to gain the benefits of the energy-based model, while retaining strong discriminative performance following a plug-and-play fashion. We deliver extensive experiments on the most popular and large scale UDA benchmarks of image classification as well as semantic segmentation to demonstrate its generality and effectiveness.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain Adaptationimage-classificationImage ClassificationSemantic SegmentationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Energy-based Self-Training and Normalization for Unsupervised Domain Adaptation
We propose an Unsupervised Domain Adaptation (UDA) method by making use of Energy-Based Learning (EBL) and demonstrate 1. EBL can be used to improve the instance selection for a self-training task on the unlabelled t…
Domain AdaptationUnsupervised Domain AdaptationUnsupervised Domain Adaptation Architecture Search with Self-Training for Land Cover Mapping
Unsupervised domain adaptation (UDA) is a challenging open problem in land cover mapping. Previous studies show encouraging progress in addressing cross-domain distribution shifts on remote sensing benchmarks for land co…
Domain AdaptationNeural Architecture SearchUnsupervised Domain AdaptationConstraining Pseudo-label in Self-training Unsupervised Domain Adaptation with Energy-based Model
Deep learning is usually data starved, and the unsupervised domain adaptation (UDA) is developed to introduce the knowledge in the labeled source domain to the unlabeled target domain. Recently, deep self-training presen…
Domain Adaptationimage-classificationImage ClassificationPseudo Label+2SGEMAS: A Self-Growing Ephemeral Multi-Agent System for Unsupervised Online Anomaly Detection via Entropic Homeostasis
Current deep learning approaches for physiological signal monitoring suffer from static topologies and constant energy consumption. We introduce SGEMAS (Self-Growing Ephemeral Multi-Agent System), a bio-inspired architec…
Unsupervised Anomaly DetectionBoosting Unsupervised Video Instance Segmentation with Automatic Quality-Guided Self-Training
Video Instance Segmentation (VIS) faces significant annotation challenges due to its dual requirements of pixel-level masks and temporal consistency labels. While recent unsupervised methods like VideoCutLER eliminate op…
Video Instance Segmentation