Fourier-Net+: Leveraging Band-Limited Representation for Efficient 3D Medical Image Registration
U-Net style networks are commonly utilized in unsupervised image registration to predict dense displacement fields, which for high-resolution volumetric image data is a resource-intensive and time-consuming task. To tackle this challenge, we first propose Fourier-Net, which replaces the costly U-Net style expansive path with a parameter-free model-driven decoder. Instead of directly predicting a full-resolution displacement field, our Fourier-Net learns a low-dimensional representation of the displacement field in the band-limited Fourier domain which our model-driven decoder converts to a full-resolution displacement field in the spatial domain. Expanding upon Fourier-Net, we then introduce Fourier-Net+, which additionally takes the band-limited spatial representation of the images as input and further reduces the number of convolutional layers in the U-Net style network's contracting path. Finally, to enhance the registration performance, we propose a cascaded version of Fourier-Net+. We evaluate our proposed methods on three datasets, on which our proposed Fourier-Net and its variants achieve comparable results with current state-of-the art methods, while exhibiting faster inference speeds, lower memory footprint, and fewer multiply-add operations. With such small computational cost, our Fourier-Net+ enables the efficient training of large-scale 3D registration on low-VRAM GPUs. Our code is publicly available at \url{https://github.com/xi-jia/Fourier-Net}.
Code (1)
Tasks
DecoderImage RegistrationMedical Image RegistrationUnsupervised Image RegistrationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fourier-Net: Fast Image Registration with Band-limited Deformation
Unsupervised image registration commonly adopts U-Net style networks to predict dense displacement fields in the full-resolution spatial domain. For high-resolution volumetric image data, this process is however resource…
DecoderImage RegistrationMedical Image RegistrationUnsupervised Image RegistrationUnlimited Sampling Theorem Based on Fractional Fourier Transform
The recovery of bandlimited signals with high dynamic range is a hot issue in sampling research. The unlimited sampling theory expands the recordable range of traditional analog-to-digital converters (ADCs) arbitrarily, …
On BT-limited Signals
In this paper, we introduce and characterize a subspace of bandlimited signals. The subspace consists of all $\Omega$ bandlimited signals such that the non-zero parts of their Fourier transforms are pieces of some $T$ ba…
A Universal Sampling Method for Reconstructing Signals with Simple Fourier Transforms
Reconstructing continuous signals from a small number of discrete samples is a fundamental problem across science and engineering. In practice, we are often interested in signals with 'simple' Fourier structure, such as …
FAN-Unet: Enhancing Unet with vision Fourier Analysis Block for Biomedical Image Segmentation
Medical image segmentation is a critical aspect of modern medical research and clinical practice. Despite the remarkable performance of Convolutional Neural Networks (CNNs) in this domain, they inherently struggle to cap…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation