paper-with-me

홈 › Papers

Latent Diffusion for Medical Image Segmentation: End to end learning for fast sampling and accuracy

2024-07-17 · Fahim Ahmed Zaman, Mathews Jacob, Amanda Chang, Kan Liu, Milan Sonka, Xiaodong Wu

Diffusion Probabilistic Models (DPMs) suffer from inefficient inference due to their slow sampling and high memory consumption, which limits their applicability to various medical imaging applications. In this work, we propose a novel conditional diffusion modeling framework (LDSeg) for medical image segmentation, utilizing the learned inherent low-dimensional latent shape manifolds of the target objects and the embeddings of the source image with an end-to-end framework. Conditional diffusion in latent space not only ensures accurate image segmentation for multiple interacting objects, but also tackles the fundamental issues of traditional DPM-based segmentation methods: (1) high memory consumption, (2) time-consuming sampling process, and (3) unnatural noise injection in the forward and reverse processes. The end-to-end training strategy enables robust representation learning in the latent space related to segmentation features, ensuring significantly faster sampling from the posterior distribution for segmentation generation in the inference phase. Our experiments demonstrate that LDSeg achieved state-of-the-art segmentation accuracy on three medical image datasets with different imaging modalities. In addition, we showed that our proposed model was significantly more robust to noise compared to traditional deterministic segmentation models. The code is available at https://github.com/FahimZaman/LDSeg.git.

📄 PDF Abstract BibTeX arXiv:2407.12952

Code (1)

fahimzaman/ldseg 공식 구현 tf

Tasks

DenoisingImage DenoisingImage GenerationImage SegmentationMedical Image SegmentationRepresentation LearningSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

LSegDiff: A Latent Diffusion Model for Medical Image Segmentation

2023-12-07 · SOICT 2023: The 12th International Symposium on Information and Communication Technology 2023 12 · Vu Quoc Hung, Tran Le Phuong Thao, Trinh Xuan Minh, Dinh Viet Sang

Initially designed for image generation, diffusion models can also be effectively applied to various tasks, including semantic segmentation. However, most existing diffusion-based approaches for semantic segmentation ope…

DecoderImage GenerationImage SegmentationMedical Image Segmentation+2

Conditional diffusion model with spatial attention and latent embedding for medical image segmentation

2025-02-10 · Behzad Hejrati, Soumyanil Banerjee, Carri Glide-Hurst, Ming Dong

Diffusion models have been used extensively for high quality image and video generation tasks. In this paper, we propose a novel conditional diffusion model with spatial attention and latent embedding (cDAL) for medical …

HippocampusImage SegmentationMedical Image SegmentationSegmentation+2

Ultrasound Image Generation using Latent Diffusion Models

2025-02-12 · Benoit Freiche, Anthony El-Khoury, Ali Nasiri-Sarvi, Mahdi S. Hosseini 외

Diffusion models for image generation have been a subject of increasing interest due to their ability to generate diverse, high-quality images. Image generation has immense potential in medical imaging because open-sourc…

Image Generation

A Fast and Efficient Modern BERT based Text-Conditioned Diffusion Model for Medical Image Segmentation

2025-11-26 · Venkata Siddharth Dhara, Pawan Kumar arxiv

In recent times, denoising diffusion probabilistic models (DPMs) have proven effective for medical image generation and denoising, and as representation learners for downstream segmentation. However, segmentation perform…

Medical Image SegmentationMedical Image GenerationClinical Knowledge

Diffusion-Based Data Augmentation for Medical Image Segmentation

2025-08-25 · Maham Nazir, Muhammad Aqeel, Francesco Setti arxiv

Medical image segmentation models struggle with rare abnormalities due to scarce annotated pathological data. We propose DiffAug a novel framework that combines textguided diffusion-based generation with automatic segmen…

Medical Image SegmentationData Augmentation