paper-with-me

홈 › Papers

Multi-Modality Conditioned Variational U-Net for Field-of-View Extension in Brain Diffusion MRI

2024-09-20 · Zhiyuan Li, Tianyuan Yao, Praitayini Kanakaraj, Chenyu Gao, Shunxing Bao, Lianrui Zuo, Michael E. Kim, Nancy R. Newlin, Gaurav Rudravaram, Nazirah M. Khairi, Yuankai Huo, Kurt G. Schilling, Walter A. Kukull, Arthur W. Toga, Derek B. Archer, Timothy J. Hohman, Bennett A. Landman

An incomplete field-of-view (FOV) in diffusion magnetic resonance imaging (dMRI) can severely hinder the volumetric and bundle analyses of whole-brain white matter connectivity. Although existing works have investigated imputing the missing regions using deep generative models, it remains unclear how to specifically utilize additional information from paired multi-modality data and whether this can enhance the imputation quality and be useful for downstream tractography. To fill this gap, we propose a novel framework for imputing dMRI scans in the incomplete part of the FOV by integrating the learned diffusion features in the acquired part of the FOV to the complete brain anatomical structure. We hypothesize that by this design the proposed framework can enhance the imputation performance of the dMRI scans and therefore be useful for repairing whole-brain tractography in corrupted dMRI scans with incomplete FOV. We tested our framework on two cohorts from different sites with a total of 96 subjects and compared it with a baseline imputation method that treats the information from T1w and dMRI scans equally. The proposed framework achieved significant improvements in imputation performance, as demonstrated by angular correlation coefficient (p < 1E-5), and in downstream tractography accuracy, as demonstrated by Dice score (p < 0.01). Results suggest that the proposed framework improved imputation performance in dMRI scans by specifically utilizing additional information from paired multi-modality data, compared with the baseline method. The imputation achieved by the proposed framework enhances whole brain tractography, and therefore reduces the uncertainty when analyzing bundles associated with neurodegenerative.

📄 PDF Abstract BibTeX arXiv:2409.13846

Code (0)

등록된 구현이 없습니다.

Tasks

Diffusion MRIImputation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Text-Image Conditioned 3D Generation

2026-03-22 · Jiazhong Cen, Jiemin Fang, Sikuang Li, Guanjun Wu 외 arxiv

High-quality 3D assets are essential for VR/AR, industrial design, and entertainment, motivating growing interest in generative models that create 3D content from user prompts. Most existing 3D generators, however, rely …

3D Generation

Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysis

2023-05-19 · Agathe Senellart, Clément Chadebec, Stéphanie Allassonnière

We propose a new multimodal variational autoencoder that enables to generate from the joint distribution and conditionally to any number of complex modalities. The unimodal posteriors are conditioned on the Deep Canonica…

Diversity

DreamPolish: Domain Score Distillation With Progressive Geometry Generation

2024-11-03 · Yean Cheng, Ziqi Cai, Ming Ding, Wendi Zheng 외

We introduce DreamPolish, a text-to-3D generation model that excels in producing refined geometry and high-quality textures. In the geometry construction phase, our approach leverages multiple neural representations to e…

3D GenerationImage GenerationText to 3DTexture Synthesis

Scalable Mean-Field Variational Inference via Preconditioned Primal-Dual Optimization

2026-02-07 · Jinhua Lyu, Tianmin Yu, Ying Ma, Naichen Shi arxiv

In this work, we investigate the large-scale mean-field variational inference (MFVI) problem from a mini-batch primal-dual perspective. By reformulating MFVI as a constrained finite-sum problem, we develop a novel primal…

VMLoc: Variational Fusion For Learning-Based Multimodal Camera Localization

2020-03-12 · Kaichen Zhou, Changhao Chen, Bing Wang, Muhamad Risqi U. Saputra 외

Recent learning-based approaches have achieved impressive results in the field of single-shot camera localization. However, how best to fuse multiple modalities (e.g., image and depth) and to deal with degraded or missin…

Camera LocalizationCamera RelocalizationVisual Localization