DynaSeg: A Deep Dynamic Fusion Method for Unsupervised Image Segmentation Incorporating Feature Similarity and Spatial Continuity
Our work tackles the fundamental challenge of image segmentation in computer vision, which is crucial for diverse applications. While supervised methods demonstrate proficiency, their reliance on extensive pixel-level annotations limits scalability. We introduce DynaSeg, an innovative unsupervised image segmentation approach that overcomes the challenge of balancing feature similarity and spatial continuity without relying on extensive hyperparameter tuning. Unlike traditional methods, DynaSeg employs a dynamic weighting scheme that automates parameter tuning, adapts flexibly to image characteristics, and facilitates easy integration with other segmentation networks. By incorporating a Silhouette Score Phase, DynaSeg prevents undersegmentation failures where the number of predicted clusters might converge to one. DynaSeg uses CNN-based and pre-trained ResNet feature extraction, making it computationally efficient and more straightforward than other complex models. Experimental results showcase state-of-the-art performance, achieving a 12.2% and 14.12% mIOU improvement over current unsupervised segmentation approaches on COCO-All and COCO-Stuff datasets, respectively. We provide qualitative and quantitative results on five benchmark datasets, demonstrating the efficacy of the proposed approach. Code available at Code available at https://github.com/RyersonMultimediaLab/DynaSeg
Code (1)
Tasks
Image SegmentationSegmentationSemantic SegmentationUnsupervised Image SegmentationUnsupervised Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DynaGuide: A Generalizable Dynamic Guidance Framework for Unsupervised Semantic Segmentation
Unsupervised image segmentation is a critical task in computer vision. It enables dense scene understanding without human annotations, which is especially valuable in domains where labelled data is scarce. However, exist…
Unsupervised Semantic SegmentationScene UnderstandingImage SegmentationFactorized Diffusion Architectures for Unsupervised Image Generation and Segmentation
We develop a neural network architecture which, trained in an unsupervised manner as a denoising diffusion model, simultaneously learns to both generate and segment images. Learning is driven entirely by the denoising di…
DenoisingImage GenerationImage SegmentationSegmentation+2Diffuse Attend and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusion
Producing quality segmentation masks for images is a fundamental problem in computer vision. Recent research has explored large-scale supervised training to enable zero-shot transfer segmentation on virtually any ima…
SegmentationvalidZero Shot SegmentationDiffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusion
Producing quality segmentation masks for images is a fundamental problem in computer vision. Recent research has explored large-scale supervised training to enable zero-shot segmentation on virtually any image style and …
SegmentationSemantic SegmentationvalidZero Shot SegmentationPeekaboo: Text to Image Diffusion Models are Zero-Shot Segmentors
Recently, text-to-image diffusion models have shown remarkable capabilities in creating realistic images from natural language prompts. However, few works have explored using these models for semantic localization or gro…
SegmentationSemantic SegmentationUnsupervised Semantic Segmentation