paper-with-me

홈 › Papers

Stable Diffusion Segmentation for Biomedical Images with Single-step Reverse Process

2024-06-26 · Tianyu Lin, Zhiguang Chen, Zhonghao Yan, Weijiang Yu, Fudan Zheng

Diffusion models have demonstrated their effectiveness across various generative tasks. However, when applied to medical image segmentation, these models encounter several challenges, including significant resource and time requirements. They also necessitate a multi-step reverse process and multiple samples to produce reliable predictions. To address these challenges, we introduce the first latent diffusion segmentation model, named SDSeg, built upon stable diffusion (SD). SDSeg incorporates a straightforward latent estimation strategy to facilitate a single-step reverse process and utilizes latent fusion concatenation to remove the necessity for multiple samples. Extensive experiments indicate that SDSeg surpasses existing state-of-the-art methods on five benchmark datasets featuring diverse imaging modalities. Remarkably, SDSeg is capable of generating stable predictions with a solitary reverse step and sample, epitomizing the model's stability as implied by its name. The code is available at https://github.com/lin-tianyu/Stable-Diffusion-Seg

📄 PDF Abstract BibTeX arXiv:2406.18361

Code (1)

lin-tianyu/stable-diffusion-seg 공식 구현 pytorch

Tasks

Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Cascaded Diffusion Models for 2D and 3D Microscopy Image Synthesis to Enhance Cell Segmentation

2024-11-18 · Rüveyda Yilmaz, Kaan Keven, Yuli Wu, Johannes Stegmaier

Automated cell segmentation in microscopy images is essential for biomedical research, yet conventional methods are labor-intensive and prone to error. While deep learning-based approaches have proven effective, they oft…

Cell SegmentationImage GenerationSegmentationSurface Reconstruction

Annotated Biomedical Video Generation using Denoising Diffusion Probabilistic Models and Flow Fields

2024-03-26 · Rüveyda Yilmaz, Dennis Eschweiler, Johannes Stegmaier

The segmentation and tracking of living cells play a vital role within the biomedical domain, particularly in cancer research, drug development, and developmental biology. These are usually tedious and time-consuming tas…

Cell SegmentationDenoisingVideo Generation

Retinal OCT Synthesis with Denoising Diffusion Probabilistic Models for Layer Segmentation

2023-11-09 · Yuli Wu, Weidong He, Dennis Eschweiler, Ningxin Dou 외

Modern biomedical image analysis using deep learning often encounters the challenge of limited annotated data. To overcome this issue, deep generative models can be employed to synthesize realistic biomedical images. In …

DenoisingImage GenerationSegmentation

Self-Attention Diffusion Models for Zero-Shot Biomedical Image Segmentation: Unlocking New Frontiers in Medical Imaging

2025-03-23 · Abderrachid Hamrani, Anuradha Godavarty

Producing high-quality segmentation masks for medical images is a fundamental challenge in biomedical image analysis. Recent research has explored large-scale supervised training to enable segmentation across various med…

Cell SegmentationDiagnosticImage SegmentationLesion Segmentation+3

Free-Mask: A Novel Paradigm of Integration Between the Segmentation Diffusion Model and Image Editing to Improve Segmentation Ability

2024-11-04 · Bo Gao, Fangxu Xing, Daniel Tang

Current semantic segmentation models typically require a substantial amount of manually annotated data, a process that is both time-consuming and resource-intensive. Alternatively, leveraging advanced text-to-image model…

SegmentationSemantic Segmentation