paper-with-me

홈 › Papers

Uncertainty-Induced Transferability Representation for Source-Free Unsupervised Domain Adaptation

2022-08-30 · Jiangbo Pei, Zhuqing Jiang, Aidong Men, Liang Chen, Yang Liu, Qingchao Chen

Source-free unsupervised domain adaptation (SFUDA) aims to learn a target domain model using unlabeled target data and the knowledge of a well-trained source domain model. Most previous SFUDA works focus on inferring semantics of target data based on the source knowledge. Without measuring the transferability of the source knowledge, these methods insufficiently exploit the source knowledge, and fail to identify the reliability of the inferred target semantics. However, existing transferability measurements require either source data or target labels, which are infeasible in SFUDA. To this end, firstly, we propose a novel Uncertainty-induced Transferability Representation (UTR), which leverages uncertainty as the tool to analyse the channel-wise transferability of the source encoder in the absence of the source data and target labels. The domain-level UTR unravels how transferable the encoder channels are to the target domain and the instance-level UTR characterizes the reliability of the inferred target semantics. Secondly, based on the UTR, we propose a novel Calibrated Adaption Framework (CAF) for SFUDA, including i)the source knowledge calibration module that guides the target model to learn the transferable source knowledge and discard the non-transferable one, and ii)the target semantics calibration module that calibrates the unreliable semantics. With the help of the calibrated source knowledge and the target semantics, the model adapts to the target domain safely and ultimately better. We verified the effectiveness of our method using experimental results and demonstrated that the proposed method achieves state-of-the-art performances on the three SFUDA benchmarks. Code is available at https://github.com/SPIresearch/UTR.

📄 PDF Abstract BibTeX arXiv:2208.13986

Code (1)

spiresearch/utr 공식 구현 pytorch

Tasks

Domain AdaptationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Balancing Discriminability and Transferability for Source-Free Domain Adaptation

2022-06-16 · Jogendra Nath Kundu, Akshay Kulkarni, Suvaansh Bhambri, Deepesh Mehta 외

Conventional domain adaptation (DA) techniques aim to improve domain transferability by learning domain-invariant representations; while concurrently preserving the task-discriminability knowledge gathered from the label…

Domain AdaptationSemantic SegmentationSource-Free Domain Adaptation

Transferability-Guided Cross-Domain Cross-Task Transfer Learning

2022-07-12 · Yang Tan, Enming Zhang, Yang Li, Shao-Lun Huang 외

We propose two novel transferability metrics F-OTCE (Fast Optimal Transport based Conditional Entropy) and JC-OTCE (Joint Correspondence OTCE) to evaluate how much the source model (task) can benefit the learning of the …

Transfer Learning

Selection, Ensemble, and Adaptation: Advancing Multi-Source-Free Domain Adaptation via Architecture Zoo

2024-03-03 · Jiangbo Pei, Ruizhe Li, Aidong Men, Yang Liu 외

Conventional Multi-Source Free Domain Adaptation (MSFDA) assumes that each source domain provides a single source model, and all source models adopt a uniform architecture. This paper introduces Zoo-MSFDA, a more general…

Domain AdaptationModel SelectionSource-Free Domain AdaptationUnsupervised Domain Adaptation

Align, Minimize and Diversify: A Source-Free Unsupervised Domain Adaptation Method for Handwritten Text Recognition

2024-04-28 · María Alfaro-Contreras, Jorge Calvo-Zaragoza

This paper serves to introduce the Align, Minimize and Diversify (AMD) method, a Source-Free Unsupervised Domain Adaptation approach for Handwritten Text Recognition (HTR). This framework decouples the adaptation process…

Domain AdaptationHandwritten Text RecognitionHTRUnsupervised Domain Adaptation

URL: A Representation Learning Benchmark for Transferable Uncertainty Estimates

2023-09-26 · NeurIPS 2023 11

Representation learning has significantly driven the field to develop pretrained models that can act as a valuable starting point when transferring to new datasets. With the rising demand for reliable machine learning an…