Domain Generalization with Fourier Transform and Soft Thresholding
Domain generalization aims to train models on multiple source domains so that they can generalize well to unseen target domains. Among many domain generalization methods, Fourier-transform-based domain generalization methods have gained popularity primarily because they exploit the power of Fourier transformation to capture essential patterns and regularities in the data, making the model more robust to domain shifts. The mainstream Fourier-transform-based domain generalization swaps the Fourier amplitude spectrum while preserving the phase spectrum between the source and the target images. However, it neglects background interference in the amplitude spectrum. To overcome this limitation, we introduce a soft-thresholding function in the Fourier domain. We apply this newly designed algorithm to retinal fundus image segmentation, which is important for diagnosing ocular diseases but the neural network's performance can degrade across different sources due to domain shifts. The proposed technique basically enhances fundus image augmentation by eliminating small values in the Fourier domain and providing better generalization. The innovative nature of the soft thresholding fused with Fourier-transform-based domain generalization improves neural network models' performance by reducing the target images' background interference significantly. Experiments on public data validate our approach's effectiveness over conventional and state-of-the-art methods with superior segmentation metrics.
Code (1)
Tasks
Domain GeneralizationImage AugmentationImage SegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Frequency-Based Federated Domain Generalization for Polyp Segmentation
Federated Learning (FL) offers a powerful strategy for training machine learning models across decentralized datasets while maintaining data privacy, yet domain shifts among clients can degrade performance, particularly …
Domain GeneralizationFederated LearningMedical Image AnalysisSegmentationAdaptive Fourier Neural Operators: Efficient Token Mixers for Transformers
Vision transformers have delivered tremendous success in representation learning. This is primarily due to effective token mixing through self attention. However, this scales quadratically with the number of pixels, whic…
Computational EfficiencyOperator learningRepresentation LearningEfficient Token Mixing for Transformers via Adaptive Fourier Neural Operators
Vision transformers have delivered tremendous success in representation learning. This is primarily due to effective token mixing through self attention. However, this scales quadratically with the number of pixels, whic…
Computational EfficiencyOperator learningRepresentation LearningOptimal Transport and Adaptive Thresholding for Universal Domain Adaptation on Time Series
Universal Domain Adaptation (UniDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain, even when their classes are not fully shared. Few dedicated UniDA methods exist for Time Series (…
Domain AdaptationTime SeriesUniversal Domain AdaptationDCT Perceptron Layer: A Transform Domain Approach for Convolution Layer
In this paper, we propose a novel Discrete Cosine Transform (DCT)-based neural network layer which we call DCT-perceptron to replace the $3\times3$ Conv2D layers in the Residual neural Network (ResNet). Convolutional fil…