Misalignment-Robust Frequency Distribution Loss for Image Transformation
This paper aims to address a common challenge in deep learning-based image transformation methods, such as image enhancement and super-resolution, which heavily rely on precisely aligned paired datasets with pixel-level alignments. However, creating precisely aligned paired images presents significant challenges and hinders the advancement of methods trained on such data. To overcome this challenge, this paper introduces a novel and simple Frequency Distribution Loss (FDL) for computing distribution distance within the frequency domain. Specifically, we transform image features into the frequency domain using Discrete Fourier Transformation (DFT). Subsequently, frequency components (amplitude and phase) are processed separately to form the FDL loss function. Our method is empirically proven effective as a training constraint due to the thoughtful utilization of global information in the frequency domain. Extensive experimental evaluations, focusing on image enhancement and super-resolution tasks, demonstrate that FDL outperforms existing misalignment-robust loss functions. Furthermore, we explore the potential of our FDL for image style transfer that relies solely on completely misaligned data. Our code is available at: https://github.com/eezkni/FDL
Code (1)
Tasks
Image EnhancementStyle TransferSuper-ResolutionSimilar Papers 제목 키워드 기반
Frequency-aware optical coherence tomography image super-resolution via conditional generative adversarial neural network
Optical coherence tomography (OCT) has stimulated a wide range of medical image-based diagnosis and treatment in fields such as cardiology and ophthalmology. Such applications can be further facilitated by deep learning-…
Deep LearningGenerative Adversarial NetworkImage ReconstructionImage Super-Resolution+1A Simple and Generic Framework for Feature Distillation via Channel-wise Transformation
Knowledge distillation is a popular technique for transferring the knowledge from a large teacher model to a smaller student model by mimicking. However, distillation by directly aligning the feature maps between teacher…
image-classificationImage ClassificationInstance SegmentationKnowledge Distillation+4Universal Adversarial Perturbations Through the Lens of Deep Steganography: Towards A Fourier Perspective
The booming interest in adversarial attacks stems from a misalignment between human vision and a deep neural network (DNN), i.e. a human imperceptible perturbation fools the DNN. Moreover, a single perturbation, often ca…
DecoderUncertainty-aware Spatial-Frequency Registration and Fusion for Infrared and Visible Images
Infrared and Visible Image Fusion (IVIF) has shown promise in visual tasks under challenging environments, but fusion under unregistered conditions faces inherent misalignments. Current studies to solve them either predi…
Analytical characterization of RIS-aided terahertz links in the presence of beam misalignment
The terahertz (THz) frequency band has recently attracted considerable attention in wireless communications as potential candidate for providing the necessary high bandwidth for demanding applications. With increasing fr…