Coupled Feature Learning for Multimodal Medical Image Fusion
Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel multimodal image fusion method based on coupled dictionary learning. The proposed method is general and can be employed for different medical imaging modalities. Unlike many current medical fusion methods, the proposed approach does not suffer from intensity attenuation nor loss of critical information. Specifically, the images to be fused are decomposed into coupled and independent components estimated using sparse representations with identical supports and a Pearson correlation constraint, respectively. An alternating minimization algorithm is designed to solve the resulting optimization problem. The final fusion step uses the max-absolute-value rule. Experiments are conducted using various pairs of multimodal inputs, including real MR-CT and MR-PET images. The resulting performance and execution times show the competitiveness of the proposed method in comparison with state-of-the-art medical image fusion methods.
Code (1)
Tasks
Dictionary LearningSimilar Papers 제목 키워드 기반
Unsupervised Multimodal 3D Medical Image Registration with Multilevel Correlation Balanced Optimization
Surgical navigation based on multimodal image registration has played a significant role in providing intraoperative guidance to surgeons by showing the relative position of the target area to critical anatomical structu…
global-optimizationImage RegistrationMedical Image RegistrationFeature Selection based on PCA and PSO for Multimodal Medical Image Fusion using DTCWT
Multimodal medical image fusion helps to increase efficiency in medical diagnosis. This paper presents multimodal medical image fusion by selecting relevant features using Principle Component Analysis (PCA) and Particle …
feature selectionMedical DiagnosisSSIMAn Attention-based Multi-Scale Feature Learning Network for Multimodal Medical Image Fusion
Medical images play an important role in clinical applications. Multimodal medical images could provide rich information about patients for physicians to diagnose. The image fusion technique is able to synthesize complem…
DiagnosticEdge-Enhanced Dilated Residual Attention Network for Multimodal Medical Image Fusion
Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. Whi…
Brain Tumor ClassificationDiagnosticSMFusion: Semantic-Preserving Fusion of Multimodal Medical Images for Enhanced Clinical Diagnosis
Multimodal medical image fusion plays a crucial role in medical diagnosis by integrating complementary information from different modalities to enhance image readability and clinical applicability. However, existing meth…
DiagnosticMedical Diagnosis