paper-with-me

홈 › Papers

Jacobian Norm for Unsupervised Source-Free Domain Adaptation

2022-04-07 · Weikai Li, Meng Cao, Songcan Chen

Unsupervised Source (data) Free domain adaptation (USFDA) aims to transfer knowledge from a well-trained source model to a related but unlabeled target domain. In such a scenario, all conventional adaptation methods that require source data fail. To combat this challenge, existing USFDAs turn to transfer knowledge by aligning the target feature to the latent distribution hidden in the source model. However, such information is naturally limited. Thus, the alignment in such a scenario is not only difficult but also insufficient, which degrades the target generalization performance. To relieve this dilemma in current USFDAs, we are motivated to explore a new perspective to boost their performance. For this purpose and gaining necessary insight, we look back upon the origin of the domain adaptation and first theoretically derive a new-brand target generalization error bound based on the model smoothness. Then, following the theoretical insight, a general and model-smoothness-guided Jacobian norm (JN) regularizer is designed and imposed on the target domain to mitigate this dilemma. Extensive experiments are conducted to validate its effectiveness. In its implementation, just with a few lines of codes added to the existing USFDAs, we achieve superior results on various benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2204.03467

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationSource-Free Domain Adaptation

Similar Papers 제목 키워드 기반

Harmonizing Flows: Unsupervised MR harmonization based on normalizing flows

2023-01-27 · Farzad Beizaee, Christian Desrosiers, Gregory A. Lodygensky, Jose Dolz

In this paper, we propose an unsupervised framework based on normalizing flows that harmonizes MR images to mimic the distribution of the source domain. The proposed framework consists of three steps. First, a shallow ha…

MRI segmentation

Harmonizing Flows: Leveraging normalizing flows for unsupervised and source-free MRI harmonization

2024-07-22 · Farzad Beizaee, Gregory A. Lodygensky, Chris L. Adamson, Deanne K. Thompso 외

Lack of standardization and various intrinsic parameters for magnetic resonance (MR) image acquisition results in heterogeneous images across different sites and devices, which adversely affects the generalization of dee…

Age EstimationMRI segmentation

Source-Free Unsupervised Domain Adaptation with Norm and Shape Constraints for Medical Image Segmentation

2022-09-03 · Satoshi Kondo

Unsupervised domain adaptation (UDA) is one of the key technologies to solve a problem where it is hard to obtain ground truth labels needed for supervised learning. In general, UDA assumes that all samples from source a…

Domain AdaptationImage SegmentationMedical Image SegmentationSemantic Segmentation+1

Continual BatchNorm Adaptation (CBNA) for Semantic Segmentation

2022-03-02 · Marvin Klingner, Mouadh Ayache, Tim Fingscheidt

Environment perception in autonomous driving vehicles often heavily relies on deep neural networks (DNNs), which are subject to domain shifts, leading to a significantly decreased performance during DNN deployment. Usual…

Autonomous DrivingDomain AdaptationSemantic SegmentationUnsupervised Domain Adaptation

Matrix-Free Two-to-Infinity and One-to-Two Norms Estimation

2025-08-06 · Askar Tsyganov, Evgeny Frolov, Sergey Samsonov, Maxim Rakhuba arxiv

In this paper, we propose new randomized algorithms for estimating the two-to-infinity and one-to-two norms in a matrix-free setting, using only matrix-vector multiplications. Our methods are based on appropriate modific…

Image Classification