paper-with-me

홈 › Papers

FetalDiffusion: Pose-Controllable 3D Fetal MRI Synthesis with Conditional Diffusion Model

2024-03-29 · Molin Zhang, Polina Golland, Patricia Ellen Grant, Elfar Adalsteinsson

The quality of fetal MRI is significantly affected by unpredictable and substantial fetal motion, leading to the introduction of artifacts even when fast acquisition sequences are employed. The development of 3D real-time fetal pose estimation approaches on volumetric EPI fetal MRI opens up a promising avenue for fetal motion monitoring and prediction. Challenges arise in fetal pose estimation due to limited number of real scanned fetal MR training images, hindering model generalization when the acquired fetal MRI lacks adequate pose. In this study, we introduce FetalDiffusion, a novel approach utilizing a conditional diffusion model to generate 3D synthetic fetal MRI with controllable pose. Additionally, an auxiliary pose-level loss is adopted to enhance model performance. Our work demonstrates the success of this proposed model by producing high-quality synthetic fetal MRI images with accurate and recognizable fetal poses, comparing favorably with in-vivo real fetal MRI. Furthermore, we show that the integration of synthetic fetal MR images enhances the fetal pose estimation model's performance, particularly when the number of available real scanned data is limited resulting in 15.4% increase in PCK and 50.2% reduced in mean error. All experiments are done on a single 32GB V100 GPU. Our method holds promise for improving real-time tracking models, thereby addressing fetal motion issues more effectively.

📄 PDF Abstract BibTeX arXiv:2404.00132

Code (0)

등록된 구현이 없습니다.

Tasks

GPUPose Estimation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

FetalFlex: Anatomy-Guided Diffusion Model for Flexible Control on Fetal Ultrasound Image Synthesis

2025-03-19 · Yaofei Duan, Tao Tan, Zhiyuan Zhu, Yuhao Huang 외

Fetal ultrasound (US) examinations require the acquisition of multiple planes, each providing unique diagnostic information to evaluate fetal development and screening for congenital anomalies. However, obtaining a compr…

AnatomyAnomaly DetectioncounterfactualDiagnostic+1

CGOF++: Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields

2022-11-23 · Keqiang Sun, Shangzhe Wu, Ning Zhang, Zhaoyang Huang 외

Capitalizing on the recent advances in image generation models, existing controllable face image synthesis methods are able to generate high-fidelity images with some levels of controllability, e.g., controlling the shap…

Face GenerationImage GenerationNeRF

Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields

2022-06-16 · Keqiang Sun, Shangzhe Wu, Zhaoyang Huang, Ning Zhang 외

Capitalizing on the recent advances in image generation models, existing controllable face image synthesis methods are able to generate high-fidelity images with some levels of controllability, e.g., controlling the shap…

Face GenerationImage GenerationNeRF

A Conditional Flow Variational Autoencoder for Controllable Synthesis of Virtual Populations of Anatomy

2023-06-26 · Haoran Dou, Nishant Ravikumar, Alejandro F. Frangi

The generation of virtual populations (VPs) of anatomy is essential for conducting in silico trials of medical devices. Typically, the generated VP should capture sufficient variability while remaining plausible and shou…

AnatomyNormalising FlowsSpecificity

CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesis

2021-06-14 · Simon Rouard, Gaëtan Hadjeres

In this paper, we propose a novel score-base generative model for unconditional raw audio synthesis. Our proposal builds upon the latest developments on diffusion process modeling with stochastic differential equations, …

Audio GenerationAudio SynthesisImage Generation