paper-with-me

Papers

NOTE: Robust Continual Test-time Adaptation Against Temporal Correlation

2022-08-10 · Taesik Gong, Jongheon Jeong, Taewon Kim, Yewon Kim, Jinwoo Shin, Sung-Ju Lee

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model adaptation. Previous TTA schemes assume that the test samples are independent and identically distributed (i.i.d.), even though they are often temporally correlated (non-i.i.d.) in application scenarios, e.g., autonomous driving. We discover that most existing TTA methods fail dramatically under such scenarios. Motivated by this, we present a new test-time adaptation scheme that is robust against non-i.i.d. test data streams. Our novelty is mainly two-fold: (a) Instance-Aware Batch Normalization (IABN) that corrects normalization for out-of-distribution samples, and (b) Prediction-balanced Reservoir Sampling (PBRS) that simulates i.i.d. data stream from non-i.i.d. stream in a class-balanced manner. Our evaluation with various datasets, including real-world non-i.i.d. streams, demonstrates that the proposed robust TTA not only outperforms state-of-the-art TTA algorithms in the non-i.i.d. setting, but also achieves comparable performance to those algorithms under the i.i.d. assumption. Code is available at https://github.com/TaesikGong/NOTE.

📄 PDF Abstract BibTeX arXiv:2208.05117

Code (1)

taesikgong/note 공식 구현 pytorch

Tasks

Autonomous DrivingTest-time Adaptation

Methods 이 논문이 사용한 방법론

Test 설명 없음
Batch Normalization 설명 없음

Similar Papers 제목 키워드 기반

Mitigating the Bias in the Model for Continual Test-Time Adaptation

2024-03-02 · Inseop Chung, Kyomin Hwang, Jayeon Yoo, Nojun Kwak

Continual Test-Time Adaptation (CTA) is a challenging task that aims to adapt a source pre-trained model to continually changing target domains. In the CTA setting, a model does not know when the target domain changes, t…

Test-time Adaptation

Continual Model Merging with Test-Time Adaptation for Whole-Slide Image Analysis

2026-07-06 · Duc-Thanh Le, Doanh C. Bui, Maï K. Nguyen, Khang Nguyen arxiv

Model merging offers a practical alternative to conventional continual learning by integrating independently fine-tuned models without retaining previous training data. Recent state-of-the-art model merging methods emplo…

Image ClassificationTest-time AdaptationContinual Learning

ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptation

2023-06-07 · Jiaming Liu, Senqiao Yang, Peidong Jia, Renrui Zhang 외

Since real-world machine systems are running in non-stationary environments, Continual Test-Time Adaptation (CTTA) task is proposed to adapt the pre-trained model to continually changing target domains. Recently, existin…

Test-time Adaptation

Continual Adversarial Defense

2023-12-15 · Qian Wang, Hefei Ling, Yingwei Li, Qihao Liu 외

In response to the rapidly evolving nature of adversarial attacks against visual classifiers on a monthly basis, numerous defenses have been proposed to generalize against as many known attacks as possible. However, desi…

Adversarial DefenseContinual LearningEnsemble LearningFew-Shot Learning

Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentation

2023-03-18 · ICCV 2023 1 · Haozhi Cao, Yuecong Xu, Jianfei Yang, Pengyu Yin 외

Continual Test-Time Adaptation (CTTA) generalizes conventional Test-Time Adaptation (TTA) by assuming that the target domain is dynamic over time rather than stationary. In this paper, we explore Multi-Modal Continual Te…

3D Semantic SegmentationSemantic SegmentationTest-time Adaptation