CodeBrain: Impute Any Brain MRI via Instance-specific Scalar-quantized Codes
MRI imputation aims to synthesize the missing modality from one or more available ones, which is highly desirable since it reduces scanning costs and delivers comprehensive MRI information to enhance clinical diagnosis. In this paper, we propose a unified model, CodeBrain, designed to adapt to various brain MRI imputation scenarios. The core design lies in casting various inter-modality transformations as a full-modality code prediction task. To this end, CodeBrain is trained in two stages: Reconstruction and Code Prediction. First, in the Reconstruction stage, we reconstruct each MRI modality, which is mapped into a shared latent space followed by a scalar quantization. Since such quantization is lossy and the code is low dimensional, another MRI modality belonging to the same subject is randomly selected to generate common features to supplement the code and boost the target reconstruction. In the second stage, we train another encoder by a customized grading loss to predict the full-modality codes from randomly masked MRI samples, supervised by the corresponding quantized codes generated from the first stage. In this way, the inter-modality transformation is achieved by mapping the instance-specific codes in a finite scalar space. We evaluated the proposed CodeBrain model on two public brain MRI datasets (i.e., IXI and BraTS 2023). Extensive experiments demonstrate that our CodeBrain model achieves superior imputation performance compared to four existing methods, establishing a new state of the art for unified brain MRI imputation. Codes will be released.
Code (0)
등록된 구현이 없습니다.
Tasks
ImputationQuantizationSimilar Papers 제목 키워드 기반
RISE and DISE: Two Frameworks for Learning from Time Series with Missing Data
Time series with missing data constitute an important setting for machine learning. The most successful prior approaches for modeling such time series are based on recurrent neural networks that learn to impute unobserve…
Missing ValuesRepresentation LearningState EstimationTime Series+1Feature-based Transformer with Incomplete Multimodal Brain Images for Diagnosis of Neurodegenerative Diseases
Benefiting from complementary information, multimodal brain imaging analysis has distinct advantages over single-modal methods for the diagnosis of neurodegenerative diseases such as Alzheimer’s disease. However, multi-m…
Imputing Brain Measurements Across Data Sets via Graph Neural Networks
Publicly available data sets of structural MRIs might not contain specific measurements of brain Regions of Interests (ROIs) that are important for training machine learning models. For example, the curvature scores comp…
Graph Neural NetworkImputationMissing ValuesWhite Matter Geometry-Guided Score-Based Diffusion Model for Tissue Microstructure Imputation in Tractography Imaging
Parcellation of white matter tractography provides anatomical features for disease prediction, anatomical tract segmentation, surgical brain mapping, and non-imaging phenotype classifications. However, parcellation does …
DenoisingDisease PredictionImputationImputation of Clinical Covariates in Time Series
Missing data is a common problem in real-world settings and particularly relevant in healthcare applications where researchers use Electronic Health Records (EHR) and results of observational studies to apply analytics m…
ImputationTime SeriesTime Series Analysis