paper-with-me

홈 › Papers

DARE-GRAM : Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matrices

2023-03-23 · Ismail Nejjar, Qin Wang, Olga Fink

Unsupervised Domain Adaptation Regression (DAR) aims to bridge the domain gap between a labeled source dataset and an unlabelled target dataset for regression problems. Recent works mostly focus on learning a deep feature encoder by minimizing the discrepancy between source and target features. In this work, we present a different perspective for the DAR problem by analyzing the closed-form ordinary least square~(OLS) solution to the linear regressor in the deep domain adaptation context. Rather than aligning the original feature embedding space, we propose to align the inverse Gram matrix of the features, which is motivated by its presence in the OLS solution and the Gram matrix's ability to capture the feature correlations. Specifically, we propose a simple yet effective DAR method which leverages the pseudo-inverse low-rank property to align the scale and angle in a selected subspace generated by the pseudo-inverse Gram matrix of the two domains. We evaluate our method on three domain adaptation regression benchmarks. Experimental results demonstrate that our method achieves state-of-the-art performance. Our code is available at https://github.com/ismailnejjar/DARE-GRAM.

📄 PDF Abstract BibTeX arXiv:2303.13325

Code (1)

ismailnejjar/dare-gram 공식 구현 pytorch

Tasks

Domain AdaptationregressionUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

DARE-GRAM: Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matrices

2023-01-01 · CVPR 2023 1 · Ismail Nejjar, Qin Wang, Olga Fink

Unsupervised Domain Adaptation Regression (DAR) aims to bridge the domain gap between a labeled source dataset and an unlabelled target dataset for regression problems. Recent works mostly focus on learning a deep fe…

Domain AdaptationregressionUnsupervised Domain Adaptation

DARec: Deep Domain Adaptation for Cross-Domain Recommendation via Transferring Rating Patterns

2019-05-26 · Feng Yuan, Lina Yao, Boualem Benatallah

Cross-domain recommendation has long been one of the major topics in recommender systems. Recently, various deep models have been proposed to transfer the learned knowledge across domains, but most of them focus on extra…

Domain AdaptationRecommendation Systems

Domain-Adjusted Regression or: ERM May Already Learn Features Sufficient for Out-of-Distribution Generalization

2022-02-14 · Elan Rosenfeld, Pradeep Ravikumar, Andrej Risteski

A common explanation for the failure of deep networks to generalize out-of-distribution is that they fail to recover the "correct" features. We challenge this notion with a simple experiment which suggests that ERM alrea…

Domain GeneralizationOut-of-Distribution Generalizationregression

Leveraging unsupervised data and domain adaptation for deep regression in low-cost sensor calibration

2022-10-02 · Swapnil Dey, Vipul Arora, Sachchida Nand Tripathi

Air quality monitoring is becoming an essential task with rising awareness about air quality. Low cost air quality sensors are easy to deploy but are not as reliable as the costly and bulky reference monitors. The low qu…

Domain AdaptationregressionSemi-supervised Domain Adaptation

Unsupervised Noise Adaptive Speech Enhancement by Discriminator-Constrained Optimal Transport

2021-11-11 · NeurIPS 2021 12 · Hsin-Yi Lin, Huan-Hsin Tseng, Xugang Lu, Yu Tsao

This paper presents a novel discriminator-constrained optimal transport network (DOTN) that performs unsupervised domain adaptation for speech enhancement (SE), which is an essential regression task in speech processing.…

Domain AdaptationSpeech EnhancementUnsupervised Domain Adaptation