Domain Adaptation with Auxiliary Target Domain-Oriented Classifier
Domain adaptation (DA) aims to transfer knowledge from a label-rich but heterogeneous domain to a label-scare domain, which alleviates the labeling efforts and attracts considerable attention. Different from previous methods focusing on learning domain-invariant feature representations, some recent methods present generic semi-supervised learning (SSL) techniques and directly apply them to DA tasks, even achieving competitive performance. One of the most popular SSL techniques is pseudo-labeling that assigns pseudo labels for each unlabeled data via the classifier trained by labeled data. However, it ignores the distribution shift in DA problems and is inevitably biased to source data. To address this issue, we propose a new pseudo-labeling framework called Auxiliary Target Domain-Oriented Classifier (ATDOC). ATDOC alleviates the classifier bias by introducing an auxiliary classifier for target data only, to improve the quality of pseudo labels. Specifically, we employ the memory mechanism and develop two types of non-parametric classifiers, i.e. the nearest centroid classifier and neighborhood aggregation, without introducing any additional network parameters. Despite its simplicity in a pseudo classification objective, ATDOC with neighborhood aggregation significantly outperforms domain alignment techniques and prior SSL techniques on a large variety of DA benchmarks and even scare-labeled SSL tasks.
Code (2)
Tasks
Domain AdaptationTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Gradual Domain Adaptation via Self-Training of Auxiliary Models
Domain adaptation becomes more challenging with increasing gaps between source and target domains. Motivated from an empirical analysis on the reliability of labeled source data for the use of distancing target domains, …
Domain AdaptationSemi-supervised Domain AdaptationMind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation
In domain adaptation, maximum mean discrepancy (MMD) has been widely adopted as a discrepancy metric between the distributions of source and target domains. However, existing MMD-based domain adaptation methods generally…
Domain AdaptationUnsupervised Domain AdaptationEmpowering GNNs for Domain Adaptation via Denoising Target Graph
We explore the node classification task in the context of graph domain adaptation, which uses both source and target graph structures along with source labels to enhance the generalization capabilities of Graph Neural Ne…
GRAPH DOMAIN ADAPTATIONNode ClassificationFast Adaptation for Human Pose Estimation via Meta-Optimization
Domain shift is a challenge for supervised human pose estimation where the source data and target data come from different distributions. This is why pose estimation methods generally perform worse on the test set th…
Auxiliary LearningImage InpaintingMeta-LearningPose Estimation+2Semi-Supervised Domain Adaptation Using Target-Oriented Domain Augmentation for 3D Object Detection
3D object detection is crucial for applications like autonomous driving and robotics. However, in real-world environments, variations in sensor data distribution due to sensor upgrades, weather changes, and geographic di…
3D Object DetectionAutonomous DrivingDomain Adaptationobject-detection+2