Test-time Fourier Style Calibration for Domain Generalization
The topic of generalizing machine learning models learned on a collection of source domains to unknown target domains is challenging. While many domain generalization (DG) methods have achieved promising results, they primarily rely on the source domains at train-time without manipulating the target domains at test-time. Thus, it is still possible that those methods can overfit to source domains and perform poorly on target domains. Driven by the observation that domains are strongly related to styles, we argue that reducing the gap between source and target styles can boost models' generalizability. To solve the dilemma of having no access to the target domain during training, we introduce Test-time Fourier Style Calibration (TF-Cal) for calibrating the target domain style on the fly during testing. To access styles, we utilize Fourier transformation to decompose features into amplitude (style) features and phase (semantic) features. Furthermore, we present an effective technique to Augment Amplitude Features (AAF) to complement TF-Cal. Extensive experiments on several popular DG benchmarks and a segmentation dataset for medical images demonstrate that our method outperforms state-of-the-art methods.
Code (1)
Tasks
Domain GeneralizationSimilar Papers 제목 키워드 기반
Towards Reliable Test-Time Adaptation: Style Invariance as a Correctness Likelihood
Test-time adaptation (TTA) enables efficient adaptation of deployed models, yet it often leads to poorly calibrated predictive uncertainty - a critical issue in high-stakes domains such as autonomous driving, finance, an…
Test-time AdaptationAutonomous DrivingFeather-Light Fourier Domain Adaptation in Magnetic Resonance Imaging
Generalizability of deep learning models may be severely affected by the difference in the distributions of the train (source domain) and the test (target domain) sets, e.g., when the sets are produced by different hardw…
Domain AdaptationFourier Test-time Adaptation with Multi-level Consistency for Robust Classification
Deep classifiers may encounter significant performance degradation when processing unseen testing data from varying centers, vendors, and protocols. Ensuring the robustness of deep models against these domain shifts is c…
Robust classificationTest-time AdaptationFourier-Net: Fast Image Registration with Band-limited Deformation
Unsupervised image registration commonly adopts U-Net style networks to predict dense displacement fields in the full-resolution spatial domain. For high-resolution volumetric image data, this process is however resource…
DecoderImage RegistrationMedical Image RegistrationUnsupervised Image RegistrationFourier-Net+: Leveraging Band-Limited Representation for Efficient 3D Medical Image Registration
U-Net style networks are commonly utilized in unsupervised image registration to predict dense displacement fields, which for high-resolution volumetric image data is a resource-intensive and time-consuming task. To tack…
DecoderImage RegistrationMedical Image RegistrationUnsupervised Image Registration