paper-with-me

홈 › Papers

Test-time Adaptation Meets Image Enhancement: Improving Accuracy via Uncertainty-aware Logit Switching

2024-03-26 · Shohei Enomoto, Naoya Hasegawa, Kazuki Adachi, Taku Sasaki, Shin'ya Yamaguchi, Satoshi Suzuki, Takeharu Eda

Deep neural networks have achieved remarkable success in a variety of computer vision applications. However, there is a problem of degrading accuracy when the data distribution shifts between training and testing. As a solution of this problem, Test-time Adaptation~(TTA) has been well studied because of its practicality. Although TTA methods increase accuracy under distribution shift by updating the model at test time, using high-uncertainty predictions is known to degrade accuracy. Since the input image is the root of the distribution shift, we incorporate a new perspective on enhancing the input image into TTA methods to reduce the prediction's uncertainty. We hypothesize that enhancing the input image reduces prediction's uncertainty and increase the accuracy of TTA methods. On the basis of our hypothesis, we propose a novel method: Test-time Enhancer and Classifier Adaptation~(TECA). In TECA, the classification model is combined with the image enhancement model that transforms input images into recognition-friendly ones, and these models are updated by existing TTA methods. Furthermore, we found that the prediction from the enhanced image does not always have lower uncertainty than the prediction from the original image. Thus, we propose logit switching, which compares the uncertainty measure of these predictions and outputs the lower one. In our experiments, we evaluate TECA with various TTA methods and show that TECA reduces prediction's uncertainty and increases accuracy of TTA methods despite having no hyperparameters and little parameter overhead.

📄 PDF Abstract BibTeX arXiv:2403.17423

Code (0)

등록된 구현이 없습니다.

Tasks

Image EnhancementTest-time Adaptation

Similar Papers 제목 키워드 기반

Diffusion-Enhanced Test-time Adaptation with Text and Image Augmentation

2024-12-12 · Chun-Mei Feng, Yuanyang He, Jian Zou, Salman Khan 외

Existing test-time prompt tuning (TPT) methods focus on single-modality data, primarily enhancing images and using confidence ratings to filter out inaccurate images. However, while image generation models can produce vi…

Image AugmentationImage GenerationTest-time Adaptation

Domain Alignment Meets Fully Test-Time Adaptation

2022-07-09 · Kowshik Thopalli, Pavan Turaga, Jayaraman J. Thiagarajan

A foundational requirement of a deployed ML model is to generalize to data drawn from a testing distribution that is different from training. A popular solution to this problem is to adapt a pre-trained model to novel do…

Domain AdaptationTest-time AdaptationUnsupervised Domain Adaptation

Enhancing and Adapting in the Clinic: Source-free Unsupervised Domain Adaptation for Medical Image Enhancement

2023-12-03 · Heng Li, Ziqin Lin, Zhongxi Qiu, Zinan Li 외

Medical imaging provides many valuable clues involving anatomical structure and pathological characteristics. However, image degradation is a common issue in clinical practice, which can adversely impact the observation …

Domain AdaptationImage EnhancementKnowledge DistillationMedical Image Enhancement+2

When Model Meets New Normals: Test-time Adaptation for Unsupervised Time-series Anomaly Detection

2023-12-19 · Dongmin Kim, Sunghyun Park, Jaegul Choo

Time-series anomaly detection deals with the problem of detecting anomalous timesteps by learning normality from the sequence of observations. However, the concept of normality evolves over time, leading to a "new normal…

Anomaly DetectionTest-time AdaptationTime SeriesTime Series Anomaly Detection

WATT: Weight Average Test-Time Adaptation of CLIP

2024-06-19 · David Osowiechi, Mehrdad Noori, Gustavo Adolfo Vargas Hakim, Moslem Yazdanpanah 외

Vision-Language Models (VLMs) such as CLIP have yielded unprecedented performance for zero-shot image classification, yet their generalization capability may still be seriously challenged when confronted to domain shifts…

image-classificationImage ClassificationOverall - TestTest-time Adaptation+1