paper-with-me

Papers

DynaSeg: A Deep Dynamic Fusion Method for Unsupervised Image Segmentation Incorporating Feature Similarity and Spatial Continuity

2024-05-09 · Boujemaa Guermazi, Naimul Khan

Our work tackles the fundamental challenge of image segmentation in computer vision, which is crucial for diverse applications. While supervised methods demonstrate proficiency, their reliance on extensive pixel-level annotations limits scalability. We introduce DynaSeg, an innovative unsupervised image segmentation approach that overcomes the challenge of balancing feature similarity and spatial continuity without relying on extensive hyperparameter tuning. Unlike traditional methods, DynaSeg employs a dynamic weighting scheme that automates parameter tuning, adapts flexibly to image characteristics, and facilitates easy integration with other segmentation networks. By incorporating a Silhouette Score Phase, DynaSeg prevents undersegmentation failures where the number of predicted clusters might converge to one. DynaSeg uses CNN-based and pre-trained ResNet feature extraction, making it computationally efficient and more straightforward than other complex models. Experimental results showcase state-of-the-art performance, achieving a 12.2% and 14.12% mIOU improvement over current unsupervised segmentation approaches on COCO-All and COCO-Stuff datasets, respectively. We provide qualitative and quantitative results on five benchmark datasets, demonstrating the efficacy of the proposed approach. Code available at Code available at https://github.com/RyersonMultimediaLab/DynaSeg

📄 PDF Abstract BibTeX arXiv:2405.05477

Code (1)

ryersonmultimedialab/dynaseg 공식 구현 pytorch

Tasks

Image SegmentationSegmentationSemantic SegmentationUnsupervised Image SegmentationUnsupervised Semantic Segmentation

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Kaiming Initialization 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Similar Papers 제목 키워드 기반

DynaGuide: A Generalizable Dynamic Guidance Framework for Unsupervised Semantic Segmentation

2026-02-13 · Boujemaa Guermazi, Riadh Ksantini, Naimul Khan arxiv

Unsupervised image segmentation is a critical task in computer vision. It enables dense scene understanding without human annotations, which is especially valuable in domains where labelled data is scarce. However, exist…

Unsupervised Semantic SegmentationScene UnderstandingImage Segmentation

Factorized Diffusion Architectures for Unsupervised Image Generation and Segmentation

2023-09-27 · Xin Yuan, Michael Maire

We develop a neural network architecture which, trained in an unsupervised manner as a denoising diffusion model, simultaneously learns to both generate and segment images. Learning is driven entirely by the denoising di…

DenoisingImage GenerationImage SegmentationSegmentation+2

Diffuse Attend and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusion

2024-01-01 · CVPR 2024 1 · Junjiao Tian, Lavisha Aggarwal, Andrea Colaco, Zsolt Kira 외

Producing quality segmentation masks for images is a fundamental problem in computer vision. Recent research has explored large-scale supervised training to enable zero-shot transfer segmentation on virtually any ima…

SegmentationvalidZero Shot Segmentation

Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusion

2023-08-23 · Junjiao Tian, Lavisha Aggarwal, Andrea Colaco, Zsolt Kira 외

Producing quality segmentation masks for images is a fundamental problem in computer vision. Recent research has explored large-scale supervised training to enable zero-shot segmentation on virtually any image style and …

SegmentationSemantic SegmentationvalidZero Shot Segmentation

Peekaboo: Text to Image Diffusion Models are Zero-Shot Segmentors

2022-11-23 · Ryan Burgert, Kanchana Ranasinghe, Xiang Li, Michael S. Ryoo

Recently, text-to-image diffusion models have shown remarkable capabilities in creating realistic images from natural language prompts. However, few works have explored using these models for semantic localization or gro…

SegmentationSemantic SegmentationUnsupervised Semantic Segmentation