paper-with-me

홈 › Papers

Rethinking the Role of Pre-Trained Networks in Source-Free Domain Adaptation

2022-12-15 · ICCV 2023 1 · Wenyu Zhang, Li Shen, Chuan-Sheng Foo

Source-free domain adaptation (SFDA) aims to adapt a source model trained on a fully-labeled source domain to an unlabeled target domain. Large-data pre-trained networks are used to initialize source models during source training, and subsequently discarded. However, source training can cause the model to overfit to source data distribution and lose applicable target domain knowledge. We propose to integrate the pre-trained network into the target adaptation process as it has diversified features important for generalization and provides an alternate view of features and classification decisions different from the source model. We propose to distil useful target domain information through a co-learning strategy to improve target pseudolabel quality for finetuning the source model. Evaluation on 4 benchmark datasets show that our proposed strategy improves adaptation performance and can be successfully integrated with existing SFDA methods. Leveraging modern pre-trained networks that have stronger representation learning ability in the co-learning strategy further boosts performance.

📄 PDF Abstract BibTeX arXiv:2212.07585

Code (1)

zwenyu/colearn-plus 공식 구현 pytorch

Tasks

Domain AdaptationRepresentation LearningSource-Free Domain AdaptationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Rethinking Domain Adaptation and Generalization in the Era of CLIP

2024-07-21 · Ruoyu Feng, Tao Yu, Xin Jin, Xiaoyuan Yu 외

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model,…

Domain AdaptationZero-Shot Learning

Rethinking the Need for Source Models: Source-Free Domain Adaptation from Scratch Guided by a Vision-Language Model

2026-05-04 · Zhou Bingtao, Xiang Mian, Ning Qian arxiv

Source-Free Domain Adaptation (SFDA) adapts source models to target domains without accessing source data, addressing privacy and transmission issues. However, existing methods still initialize from a source pre-trained …

Source-Free Domain Adaptation

Rethinking the Backbone in Class Imbalanced Federated Source Free Domain Adaptation: The Utility of Vision Foundation Models

2025-09-10 · Kosuke Kihara, Junki Mori, Taiki Miyagawa, Akinori F. Ebihara arxiv

Federated Learning (FL) offers a framework for training models collaboratively while preserving data privacy of each client. Recently, research has focused on Federated Source-Free Domain Adaptation (FFREEDA), a more rea…

Source-Free Domain AdaptationFederated Learning

FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularization

2023-03-13 · CVPR 2023 1 · Jiawei Yang, Marco Pavone, Yue Wang

Novel view synthesis with sparse inputs is a challenging problem for neural radiance fields (NeRF). Recent efforts alleviate this challenge by introducing external supervision, such as pre-trained models and extra depth …

NeRFNeural RenderingNovel View Synthesis

Rethinking Propagation for Unsupervised Graph Domain Adaptation

2024-02-08 · Meihan Liu, Zeyu Fang, Zhen Zhang, Ming Gu 외

Unsupervised Graph Domain Adaptation (UGDA) aims to transfer knowledge from a labelled source graph to an unlabelled target graph in order to address the distribution shifts between graph domains. Previous works have pri…

Domain AdaptationGRAPH DOMAIN ADAPTATION