Revisiting Deep Subspace Alignment for Unsupervised Domain Adaptation
Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledge from a labeled source domain to an unlabeled target domain. Traditionally, subspace-based methods form an important class of solutions to this problem. Despite their mathematical elegance and tractability, these methods are often found to be ineffective at producing domain-invariant features with complex, real-world datasets. Motivated by the recent advances in representation learning with deep networks, this paper revisits the use of subspace alignment for UDA and proposes a novel adaptation algorithm that consistently leads to improved generalization. In contrast to existing adversarial training-based DA methods, our approach isolates feature learning and distribution alignment steps, and utilizes a primary-auxiliary optimization strategy to effectively balance the objectives of domain invariance and model fidelity. While providing a significant reduction in target data and computational requirements, our subspace-based DA performs competitively and sometimes even outperforms state-of-the-art approaches on several standard UDA benchmarks. Furthermore, subspace alignment leads to intrinsically well-regularized models that demonstrate strong generalization even in the challenging partial DA setting. Finally, the design of our UDA framework inherently supports progressive adaptation to new target domains at test-time, without requiring retraining of the model from scratch. In summary, powered by powerful feature learners and an effective optimization strategy, we establish subspace-based DA as a highly effective approach for visual recognition.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationRepresentation LearningUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Landmarks-Based Kernelized Subspace Alignment for Unsupervised Domain Adaptation
Domain adaptation (DA) has gained a lot of success in the recent years in computer vision to deal with situations where the learning process has to transfer knowledge from a source to a target domain. In this paper, we i…
Domain AdaptationUnsupervised Domain AdaptationSubspace Alignment Based Domain Adaptation for RCNN Detector
In this paper, we propose subspace alignment based domain adaptation of the state of the art RCNN based object detector. The aim is to be able to achieve high quality object detection in novel, real world target scenario…
Domain AdaptationObjectobject-detectionObject Detection+1SALT: Subspace Alignment as an Auxiliary Learning Task for Domain Adaptation
Unsupervised domain adaptation aims to transfer and adapt knowledge learned from a labeled source domain to an unlabeled target domain. Key components of unsupervised domain adaptation include: (a) maximizing performance…
Auxiliary LearningDomain AdaptationFormUnsupervised Domain AdaptationMultiple Subspace Alignment Improves Domain Adaptation
We present a novel unsupervised domain adaptation (DA) method for cross-domain visual recognition. Though subspace methods have found success in DA, their performance is often limited due to the assumption of approximati…
Domain Adaptationsubspace methodsUnsupervised Domain AdaptationDomain Alignment Meets Fully Test-Time Adaptation
A foundational requirement of a deployed ML model is to generalize to data drawn from a testing distribution that is different from training. A popular solution to this problem is to adapt a pre-trained model to novel do…
Domain AdaptationTest-time AdaptationUnsupervised Domain Adaptation