paper-with-me

홈 › Papers

Diffusion Model Driven Test-Time Image Adaptation for Robust Skin Lesion Classification

2024-05-18 · Ming Hu, Siyuan Yan, Peng Xia, Feilong Tang, Wenxue Li, Peibo Duan, Lin Zhang, ZongYuan Ge

Deep learning-based diagnostic systems have demonstrated potential in skin disease diagnosis. However, their performance can easily degrade on test domains due to distribution shifts caused by input-level corruptions, such as imaging equipment variability, brightness changes, and image blur. This will reduce the reliability of model deployment in real-world scenarios. Most existing solutions focus on adapting the source model through retraining on different target domains. Although effective, this retraining process is sensitive to the amount of data and the hyperparameter configuration for optimization. In this paper, we propose a test-time image adaptation method to enhance the accuracy of the model on test data by simultaneously updating and predicting test images. We modify the target test images by projecting them back to the source domain using a diffusion model. Specifically, we design a structure guidance module that adds refinement operations through low-pass filtering during reverse sampling, regularizing the diffusion to preserve structural information. Additionally, we introduce a self-ensembling scheme automatically adjusts the reliance on adapted and unadapted inputs, enhancing adaptation robustness by rejecting inappropriate generative modeling results. To facilitate this study, we constructed the ISIC2019-C and Dermnet-C corruption robustness evaluation benchmarks. Extensive experiments on the proposed benchmarks demonstrate that our method makes the classifier more robust across various corruptions, architectures, and data regimes. Our datasets and code will be available at \url{https://github.com/minghu0830/Skin-TTA_Diffusion}.

📄 PDF Abstract BibTeX arXiv:2405.11289

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticLesion ClassificationSkin Lesion Classification

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Back to the Source: Diffusion-Driven Test-Time Adaptation

2022-07-07 · Jin Gao, Jialing Zhang, Xihui Liu, Trevor Darrell 외

Test-time adaptation harnesses test inputs to improve the accuracy of a model trained on source data when tested on shifted target data. Existing methods update the source model by (re-)training on each target domain. Wh…

Test-time Adaptation

Back to the Source: Diffusion-Driven Adaptation To Test-Time Corruption

2023-01-01 · CVPR 2023 1 · Jin Gao, Jialing Zhang, Xihui Liu, Trevor Darrell 외

Test-time adaptation harnesses test inputs to improve the accuracy of a model trained on source data when tested on shifted target data. Most methods update the source model by (re-)training on each target domain. Wh…

Test-time Adaptation

FOCUS: Frequency-Optimized Conditioning of DiffUSion Models for mitigating catastrophic forgetting during Test-Time Adaptation

2025-08-20 · Gabriel Tjio, Jie Zhang, Xulei Yang, Yun Xing 외 arxiv

Test-time adaptation enables models to adapt to evolving domains. However, balancing the tradeoff between preserving knowledge and adapting to domain shifts remains challenging for model adaptation methods, since adaptin…

Monocular Depth EstimationSemantic SegmentationTest-time AdaptationData Augmentation

SteeringTTA: Guiding Diffusion Trajectories for Robust Test-Time-Adaptation

2025-10-16 · Jihyun Yu, Yoojin Oh, Wonho Bae, Mingyu Kim 외 arxiv

Test-time adaptation (TTA) aims to correct performance degradation of deep models under distribution shifts by updating models or inputs using unlabeled test data. Input-only diffusion-based TTA methods improve robustnes…

Test-time Adaptation

Efficient Diffusion-Driven Corruption Editor for Test-Time Adaptation

2024-03-16 · Yeongtak Oh, Jonghyun Lee, Jooyoung Choi, Dahuin Jung 외

Test-time adaptation (TTA) addresses the unforeseen distribution shifts occurring during test time. In TTA, performance, memory consumption, and time consumption are crucial considerations. A recent diffusion-based TTA a…

Data AugmentationTest-time Adaptation