LSegDiff: A Latent Diffusion Model for Medical Image Segmentation
Initially designed for image generation, diffusion models can also be effectively applied to various tasks, including semantic segmentation. However, most existing diffusion-based approaches for semantic segmentation operate in high-dimensional pixel space, demanding a lot of computing and memory resources during training and inference. This paper makes the first attempt to utilize latent diffusion models for semantic segmentation. Specifically, we propose a fast yet effective latent diffusion model and valuate it on medical image segmentation tasks. Firstly, we train a Variational Autoencoder (VAE) network to convert binary image masks into compact latent vectors. The diffusion process can then be executed in this low-dimensional latent space and thus drastically accelerated. Subsequently, we employ the VAE decoder to reconstruct a precise prediction map from the latent output vector produced by the diffusion process. Eventually, we refine the final segmentation results through a straightforward post-processing step using morphological operations. We report our results on two public datasets, including colon polyp images and skin cancer images. Experiments show that our approach achieves competitive accuracy compared to traditional diffusion models while having much better training and inference speed, as well as much more efficient memory consumption.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderImage GenerationImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Latent Diffusion for Medical Image Segmentation: End to end learning for fast sampling and accuracy
Diffusion Probabilistic Models (DPMs) suffer from inefficient inference due to their slow sampling and high memory consumption, which limits their applicability to various medical imaging applications. In this work, we p…
DenoisingImage DenoisingImage GenerationImage Segmentation+4Conditional diffusion model with spatial attention and latent embedding for medical image segmentation
Diffusion models have been used extensively for high quality image and video generation tasks. In this paper, we propose a novel conditional diffusion model with spatial attention and latent embedding (cDAL) for medical …
HippocampusImage SegmentationMedical Image SegmentationSegmentation+2Diffusion-Based Data Augmentation for Medical Image Segmentation
Medical image segmentation models struggle with rare abnormalities due to scarce annotated pathological data. We propose DiffAug a novel framework that combines textguided diffusion-based generation with automatic segmen…
Medical Image SegmentationData AugmentationLEAF: Latent Diffusion with Efficient Encoder Distillation for Aligned Features in Medical Image Segmentation
Leveraging the powerful capabilities of diffusion models has yielded quite effective results in medical image segmentation tasks. However, existing methods typically transfer the original training process directly withou…
Medical Image SegmentationRobust Noisy Pseudo-label Learning for Semi-supervised Medical Image Segmentation Using Diffusion Model
Obtaining pixel-level annotations in the medical domain is both expensive and time-consuming, often requiring close collaboration between clinical experts and developers. Semi-supervised medical image segmentation aims t…
Semi-supervised Medical Image SegmentationObject Segmentation