Principal Component Clustering for Semantic Segmentation in Synthetic Data Generation

2024-06-25 · Felix Stillger, Frederik Hasecke, Tobias Meisen

This technical report outlines our method for generating a synthetic dataset for semantic segmentation using a latent diffusion model. Our approach eliminates the need for additional models specifically trained on segmentation data and is part of our submission to the CVPR 2024 workshop challenge, entitled CVPR 2024 workshop challenge "SyntaGen Harnessing Generative Models for Synthetic Visual Datasets". Our methodology uses self-attentions to facilitate a novel head-wise semantic information condensation, thereby enabling the direct acquisition of class-agnostic image segmentation from the Stable Diffusion latents. Furthermore, we employ non-prompt-influencing cross-attentions from text to pixel, thus facilitating the classification of the previously generated masks. Finally, we propose a mask refinement step by using only the output image by Stable Diffusion.

📄 PDF Abstract BibTeX arXiv:2406.17541

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringImage Segmentation Segmentation Semantic Segmentation Synthetic Data Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Fast PET Scan Tumor Segmentation using Superpixels, Principal Component Analysis and K-means Clustering

2017-10-18 · Yeman B. Hagos, Vu H. Minh, Saed Khawaldeh, Usama Pervaiz 외

Positron Emission Tomography scan images are extensively used in radiotherapy planning, clinical diagnosis, assessment of growth and treatment of a tumor. These all rely on fidelity and speed of detection and delineation…

Clustering Superpixels Tumor Segmentation

Community Detection by Principal Components Clustering Methods

2020-11-09 · Huan Qing, Jingli Wang

Based on the classical Degree Corrected Stochastic Blockmodel (DCSBM) model for network community detection problem, we propose two novel approaches: principal component clustering (PCC) and normalized principal componen…

Clustering Community Detection

Subspace Clustering with Active Learning

2019-11-08 · Hankui Peng, Nicos G. Pavlidis

Subspace clustering is a growing field of unsupervised learning that has gained much popularity in the computer vision community. Applications can be found in areas such as motion segmentation and face clustering. It ass…

Active Learning Clustering Face Clustering Motion Segmentation

Systematic study of color spaces and components for the segmentation of sky/cloud images

2017-01-17 · Soumyabrata Dev, Yee Hui Lee, Stefan Winkler

Sky/cloud imaging using ground-based Whole Sky Imagers (WSI) is a cost-effective means to understanding cloud cover and weather patterns. The accurate segmentation of clouds in these images is a challenging task, as clou…

Clustering Segmentation

Detection and tracking of gas plumes in LWIR hyperspectral video sequence data

2024-11-01 · Torin Gerhart, Justin Sunu, Ekaterina Merkurjev, Jen-Mei Chang 외

Automated detection of chemical plumes presents a segmentation challenge. The segmentation problem for gas plumes is difficult due to the diffusive nature of the cloud. The advantage of considering hyperspectral images i…

Clustering Dimensionality Reduction Segmentation