Variational Continual Test-Time Adaptation
The prior drift is crucial in Continual Test-Time Adaptation (CTTA) methods that only use unlabeled test data, as it can cause significant error propagation. In this paper, we introduce VCoTTA, a variational Bayesian approach to measure uncertainties in CTTA. At the source stage, we transform a pre-trained deterministic model into a Bayesian Neural Network (BNN) via a variational warm-up strategy, injecting uncertainties into the model. During the testing time, we employ a mean-teacher update strategy using variational inference for the student model and exponential moving average for the teacher model. Our novel approach updates the student model by combining priors from both the source and teacher models. The evidence lower bound is formulated as the cross-entropy between the student and teacher models, along with the Kullback-Leibler (KL) divergence of the prior mixture. Experimental results on three datasets demonstrate the method's effectiveness in mitigating prior drift within the CTTA framework.
Code (0)
등록된 구현이 없습니다.
Tasks
Test-time AdaptationVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentation
Continual Test-Time Adaptation (CTTA) generalizes conventional Test-Time Adaptation (TTA) by assuming that the target domain is dynamic over time rather than stationary. In this paper, we explore Multi-Modal Continual Te…
3D Semantic SegmentationSemantic SegmentationTest-time AdaptationGeneralized Robust Test-Time Adaptation in Continuous Dynamic Scenarios
Test-time adaptation (TTA) adapts the pre-trained models to test distributions during the inference phase exclusively employing unlabeled test data streams, which holds great value for the deployment of models in real-wo…
Test-time AdaptationEvaluating Continual Test-Time Adaptation for Contextual and Semantic Domain Shifts
In this paper, our goal is to adapt a pre-trained convolutional neural network to domain shifts at test time. We do so continually with the incoming stream of test batches, without labels. The existing literature mostly …
Test-time AdaptationMaintain Plasticity in Long-timescale Continual Test-time Adaptation
Continual test-time domain adaptation (CTTA) aims to adjust pre-trained source models to perform well over time across non-stationary target environments. While previous methods have made considerable efforts to optimize…
Domain AdaptationTest-time AdaptationContinual Model Merging with Test-Time Adaptation for Whole-Slide Image Analysis
Model merging offers a practical alternative to conventional continual learning by integrating independently fine-tuned models without retaining previous training data. Recent state-of-the-art model merging methods emplo…
Image ClassificationTest-time AdaptationContinual Learning