Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction
Magnetic resonance imaging (MRI) with high resolution (HR) provides more detailed information for accurate diagnosis and quantitative image analysis. Despite the significant advances, most existing super-resolution (SR) reconstruction network for medical images has two flaws: 1) All of them are designed in a black-box principle, thus lacking sufficient interpretability and further limiting their practical applications. Interpretable neural network models are of significant interest since they enhance the trustworthiness required in clinical practice when dealing with medical images. 2) most existing SR reconstruction approaches only use a single contrast or use a simple multi-contrast fusion mechanism, neglecting the complex relationships between different contrasts that are critical for SR improvement. To deal with these issues, in this paper, a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction is proposed. The Model-Guided image SR reconstruction approach solves manually designed objective functions to reconstruct HR MRI. We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix and explicit multi-contrast relationship matrix into account during the end-to-end optimization. Extensive experiments on the multi-contrast IXI dataset and BraTs 2019 dataset demonstrate the superiority of our proposed model.
Code (1)
Tasks
Super-ResolutionSimilar Papers 제목 키워드 기반
Multimodal Deep Unfolding for Guided Image Super-Resolution
The reconstruction of a high resolution image given a low resolution observation is an ill-posed inverse problem in imaging. Deep learning methods rely on training data to learn an end-to-end mapping from a low-resolutio…
Image Super-ResolutionMultimodal Deep LearningSuper-ResolutionDeep unfolding Network for Hyperspectral Image Super-Resolution with Automatic Exposure Correction
In recent years, the fusion of high spatial resolution multispectral image (HR-MSI) and low spatial resolution hyperspectral image (LR-HSI) has been recognized as an effective method for HSI super-resolution (HSI-SR). Ho…
Exposure CorrectionHyperspectral Image Super-ResolutionImage Super-ResolutionSuper-ResolutionStructural Similarity-Inspired Unfolding for Lightweight Image Super-Resolution
Major efforts in data-driven image super-resolution (SR) primarily focus on expanding the receptive field of the model to better capture contextual information. However, these methods are typically implemented by stackin…
Image Super-ResolutionMixture-of-ExpertsSuper-ResolutionAccurate and Lightweight Image Super-Resolution with Model-Guided Deep Unfolding Network
Deep neural networks (DNNs) based methods have achieved great success in single image super-resolution (SISR). However, existing state-of-the-art SISR techniques are designed like black boxes lacking transparency and int…
DenoisingImage Super-ResolutionSuper-ResolutionMultimodal Image Super-resolution via Deep Unfolding with Side Information
Deep learning methods have been successfully applied to various computer vision tasks. However, existing neural network architectures do not per se incorporate domain knowledge about the addressed problem, thus, understa…
Image Super-ResolutionSuper-Resolution