paper-with-me

홈 › Papers

Self-Attention Diffusion Models for Zero-Shot Biomedical Image Segmentation: Unlocking New Frontiers in Medical Imaging

2025-03-23 · Abderrachid Hamrani, Anuradha Godavarty

Producing high-quality segmentation masks for medical images is a fundamental challenge in biomedical image analysis. Recent research has explored large-scale supervised training to enable segmentation across various medical imaging modalities and unsupervised training to facilitate segmentation without dense annotations. However, constructing a model capable of segmenting diverse medical images in a zero-shot manner without any annotations remains a significant hurdle. This paper introduces the Attention Diffusion Zero-shot Unsupervised System (ADZUS), a novel approach that leverages self-attention diffusion models for zero-shot biomedical image segmentation. ADZUS harnesses the intrinsic capabilities of pre-trained diffusion models, utilizing their generative and discriminative potentials to segment medical images without requiring annotated training data or prior domain-specific knowledge. The ADZUS architecture is detailed, with its integration of self-attention mechanisms that facilitate context-aware and detail-sensitive segmentations being highlighted. Experimental results across various medical imaging datasets, including skin lesion segmentation, chest X-ray infection segmentation, and white blood cell segmentation, reveal that ADZUS achieves state-of-the-art performance. Notably, ADZUS reached Dice scores ranging from 88.7\% to 92.9\% and IoU scores from 66.3\% to 93.3\% across different segmentation tasks, demonstrating significant improvements in handling novel, unseen medical imagery. It is noteworthy that while ADZUS demonstrates high effectiveness, it demands substantial computational resources and extended processing times. The model's efficacy in zero-shot settings underscores its potential to reduce reliance on costly annotations and seamlessly adapt to new medical imaging tasks, thereby expanding the diagnostic capabilities of AI-driven medical imaging technologies.

📄 PDF Abstract BibTeX arXiv:2503.18170

Code (0)

등록된 구현이 없습니다.

Tasks

Cell SegmentationDiagnosticImage SegmentationLesion SegmentationSegmentationSemantic SegmentationSkin Lesion Segmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Diffuse Attend and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusion

2024-01-01 · CVPR 2024 1 · Junjiao Tian, Lavisha Aggarwal, Andrea Colaco, Zsolt Kira 외

Producing quality segmentation masks for images is a fundamental problem in computer vision. Recent research has explored large-scale supervised training to enable zero-shot transfer segmentation on virtually any ima…

SegmentationvalidZero Shot Segmentation

Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusion

2023-08-23 · Junjiao Tian, Lavisha Aggarwal, Andrea Colaco, Zsolt Kira 외

Producing quality segmentation masks for images is a fundamental problem in computer vision. Recent research has explored large-scale supervised training to enable zero-shot segmentation on virtually any image style and …

SegmentationSemantic SegmentationvalidZero Shot Segmentation

Zero-Shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model

2024-07-02 · Cong Cao, Huanjing Yue, Xin Liu, Jingyu Yang

Diffusion-based zero-shot image restoration and enhancement models have achieved great success in various tasks of image restoration and enhancement. However, directly applying them to video restoration and enhancement r…

Image RestorationVideo Restoration

Boundary Attention Constrained Zero-Shot Layout-To-Image Generation

2024-11-15 · Huancheng Chen, Jingtao Li, Weiming Zhuang, Haris Vikalo 외

Recent text-to-image diffusion models excel at generating high-resolution images from text but struggle with precise control over spatial composition and object counting. To address these challenges, several studies deve…

Image GenerationLayout-to-Image GenerationObject Counting

FateZero: Fusing Attentions for Zero-shot Text-based Video Editing

2023-03-16 · ICCV 2023 1 · Chenyang Qi, Xiaodong Cun, Yong Zhang, Chenyang Lei 외

The diffusion-based generative models have achieved remarkable success in text-based image generation. However, since it contains enormous randomness in generation progress, it is still challenging to apply such models f…

AttributeText-to-Video EditingVideo EditingVideo Style Transfer