DARE-GRAM : Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matrices
Unsupervised Domain Adaptation Regression (DAR) aims to bridge the domain gap between a labeled source dataset and an unlabelled target dataset for regression problems. Recent works mostly focus on learning a deep feature encoder by minimizing the discrepancy between source and target features. In this work, we present a different perspective for the DAR problem by analyzing the closed-form ordinary least square~(OLS) solution to the linear regressor in the deep domain adaptation context. Rather than aligning the original feature embedding space, we propose to align the inverse Gram matrix of the features, which is motivated by its presence in the OLS solution and the Gram matrix's ability to capture the feature correlations. Specifically, we propose a simple yet effective DAR method which leverages the pseudo-inverse low-rank property to align the scale and angle in a selected subspace generated by the pseudo-inverse Gram matrix of the two domains. We evaluate our method on three domain adaptation regression benchmarks. Experimental results demonstrate that our method achieves state-of-the-art performance. Our code is available at https://github.com/ismailnejjar/DARE-GRAM.
Code (1)
Tasks
Domain AdaptationregressionUnsupervised Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DARE-GRAM: Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matrices
Unsupervised Domain Adaptation Regression (DAR) aims to bridge the domain gap between a labeled source dataset and an unlabelled target dataset for regression problems. Recent works mostly focus on learning a deep fe…
Domain AdaptationregressionUnsupervised Domain AdaptationDARec: Deep Domain Adaptation for Cross-Domain Recommendation via Transferring Rating Patterns
Cross-domain recommendation has long been one of the major topics in recommender systems. Recently, various deep models have been proposed to transfer the learned knowledge across domains, but most of them focus on extra…
Domain AdaptationRecommendation SystemsDomain-Adjusted Regression or: ERM May Already Learn Features Sufficient for Out-of-Distribution Generalization
A common explanation for the failure of deep networks to generalize out-of-distribution is that they fail to recover the "correct" features. We challenge this notion with a simple experiment which suggests that ERM alrea…
Domain GeneralizationOut-of-Distribution GeneralizationregressionLeveraging unsupervised data and domain adaptation for deep regression in low-cost sensor calibration
Air quality monitoring is becoming an essential task with rising awareness about air quality. Low cost air quality sensors are easy to deploy but are not as reliable as the costly and bulky reference monitors. The low qu…
Domain AdaptationregressionSemi-supervised Domain AdaptationUnsupervised Noise Adaptive Speech Enhancement by Discriminator-Constrained Optimal Transport
This paper presents a novel discriminator-constrained optimal transport network (DOTN) that performs unsupervised domain adaptation for speech enhancement (SE), which is an essential regression task in speech processing.…
Domain AdaptationSpeech EnhancementUnsupervised Domain Adaptation