paper-with-me

Papers

A Versatile Framework for Continual Test-Time Domain Adaptation: Balancing Discriminability and Generalizability

2024-01-01 · CVPR 2024 1 · Xu Yang, Xuan Chen, Moqi Li, Kun Wei, Cheng Deng

Continual test-time domain adaptation (CTTA) aims to adapt the source pre-trained model to a continually changing target domain without additional data acquisition or labeling costs. This issue necessitates an initial performance enhancement within the present domain without labels while concurrently averting an excessive bias toward the current domain. Such bias exacerbates catastrophic forgetting and diminishes the generalization ability to future domains. To tackle the problem this paper designs a versatile framework to capture high-quality supervision signals from three aspects: 1) The adaptive thresholds are employed to determine the reliability of pseudo-labels; 2) The knowledge from the source pre-trained model is utilized to adjust the unreliable one and 3) By evaluating past supervision signals we calculate a diversity score to ensure subsequent generalization. In this way we form a complete supervisory signal generation framework which can capture the current domain discriminative and reserve generalization in future domains. Finally to avoid catastrophic forgetting we design a weighted soft parameter alignment method to explore the knowledge from the source model. Extensive experimental results demonstrate that our method performs well on several benchmark datasets.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityDomain Adaptation

Similar Papers 제목 키워드 기반

UniTTA: Unified Benchmark and Versatile Framework Towards Realistic Test-Time Adaptation

2024-07-29 · Chaoqun Du, Yulin Wang, Jiayi Guo, Yizeng Han 외

Test-Time Adaptation (TTA) aims to adapt pre-trained models to the target domain during testing. In reality, this adaptability can be influenced by multiple factors. Researchers have identified various challenging scenar…

Test-time Adaptation

Continual Test-time Adaptation for End-to-end Speech Recognition on Noisy Speech

2024-06-16 · Guan-Ting Lin, Wei-Ping Huang, Hung-Yi Lee

Deep Learning-based end-to-end Automatic Speech Recognition (ASR) has made significant strides but still struggles with performance on out-of-domain samples due to domain shifts in real-world scenarios. Test-Time Adaptat…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1

CTTA-T: Continual Test-Time Adaptation for Text Understanding via Teacher-Student with a Domain-aware and Generalized Teacher

2025-12-20 · Tianlun Liu, Zhiliang Tian, Zhen Huang, Xingzhi Zhou 외 arxiv

Text understanding often suffers from domain shifts. To handle testing domains, domain adaptation (DA) is trained to adapt to a fixed and observed testing domain; a more challenging paradigm, test-time adaptation (TTA), …

Test-time AdaptationDomain Adaptation

PCoTTA: Continual Test-Time Adaptation for Multi-Task Point Cloud Understanding

2024-11-01 · Jincen Jiang, Qianyu Zhou, Yuhang Li, Xinkui Zhao 외

In this paper, we present PCoTTA, an innovative, pioneering framework for Continual Test-Time Adaptation (CoTTA) in multi-task point cloud understanding, enhancing the model's transferability towards the continually chan…

Test-time Adaptation

D^3CTTA: Domain-Dependent Decorrelation for Continual Test-Time Adaption of 3D LiDAR Segmentation

2025-01-01 · CVPR 2025 1 · Jichun Zhao, Haiyong Jiang, Haoxuan Song, Jun Xiao 외

Adapting pre-trained LiDAR segmentation models to dynamic domain shifts during testing is of paramount importance for the safety of autonomous driving. Most existing methods neglect the influence of domain changes a…

Autonomous DrivingSegmentation