paper-with-me

홈 › Papers

Unveiling the Superior Paradigm: A Comparative Study of Source-Free Domain Adaptation and Unsupervised Domain Adaptation

2024-11-24 · Fan Wang, Zhongyi Han, Xingbo Liu, Xin Gao, Yilong Yin

In domain adaptation, there are two popular paradigms: Unsupervised Domain Adaptation (UDA), which aligns distributions using source data, and Source-Free Domain Adaptation (SFDA), which leverages pre-trained source models without accessing source data. Evaluating the superiority of UDA versus SFDA is an open and timely question with significant implications for deploying adaptive algorithms in practical applications. In this study, we demonstrate through predictive coding theory and extensive experiments on multiple benchmark datasets that SFDA generally outperforms UDA in real-world scenarios. Specifically, SFDA offers advantages in time efficiency, storage requirements, targeted learning objectives, reduced risk of negative transfer, and increased robustness against overfitting. Notably, SFDA is particularly effective in mitigating negative transfer when there are substantial distribution discrepancies between source and target domains. Additionally, we introduce a novel data-model fusion scenario, where data sharing among stakeholders varies (e.g., some provide raw data while others provide only models), and reveal that traditional UDA and SFDA methods do not fully exploit their potential in this context. To address this limitation and capitalize on the strengths of SFDA, we propose a novel weight estimation method that effectively integrates available source data into multi-SFDA (MSFDA) approaches, thereby enhancing model performance within this scenario. This work provides a thorough analysis of UDA versus SFDA and advances a practical approach to model adaptation across diverse real-world environments.

📄 PDF Abstract BibTeX arXiv:2411.15844

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationSource-Free Domain AdaptationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Unveiling Comparative Sentiments in Vietnamese Product Reviews: A Sequential Classification Framework

2024-01-02 · Ha Le, Bao Tran, Phuong Le, Tan Nguyen 외

Comparative opinion mining is a specialized field of sentiment analysis that aims to identify and extract sentiments expressed comparatively. To address this task, we propose an approach that consists of solving three se…

Opinion MiningSentenceSentiment Analysis

Are Large Language Models Good Fact Checkers: A Preliminary Study

2023-11-29 · Han Cao, Lingwei Wei, Mengyang Chen, Wei Zhou 외

Recently, Large Language Models (LLMs) have drawn significant attention due to their outstanding reasoning capabilities and extensive knowledge repository, positioning them as superior in handling various natural languag…

Fact CheckingFact Verification

End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems

2026-10-01 · Kartik B. Kapse arxiv

Autonomous driving systems have become a central focus of intelligent transportation research, with End-to-End Learning and Modular Architectures offering two prominent design paradigms for their implementation. E2E Lear…

Autonomous Driving

Unveiling the Role of Expert Guidance: A Comparative Analysis of User-centered Imitation Learning and Traditional Reinforcement Learning

2024-10-28 · Amr Gomaa, Bilal Mahdy

Integration of human feedback plays a key role in improving the learning capabilities of intelligent systems. This comparative study delves into the performance, robustness, and limitations of imitation learning compared…

Imitation LearningUnity

Superiority of Softmax: Unveiling the Performance Edge Over Linear Attention

2023-10-18 · Yichuan Deng, Zhao Song, Tianyi Zhou

Large transformer models have achieved state-of-the-art results in numerous natural language processing tasks. Among the pivotal components of the transformer architecture, the attention mechanism plays a crucial role in…