Labels4Free: Unsupervised Segmentation using StyleGAN
We propose an unsupervised segmentation framework for StyleGAN generated objects. We build on two main observations. First, the features generated by StyleGAN hold valuable information that can be utilized towards training segmentation networks. Second, the foreground and background can often be treated to be largely independent and be composited in different ways. For our solution, we propose to augment the StyleGAN2 generator architecture with a segmentation branch and to split the generator into a foreground and background network. This enables us to generate soft segmentation masks for the foreground object in an unsupervised fashion. On multiple object classes, we report comparable results against state-of-the-art supervised segmentation networks, while against the best unsupervised segmentation approach we demonstrate a clear improvement, both in qualitative and quantitative metrics.
Code (1)
Tasks
SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CLIP2StyleGAN: Unsupervised Extraction of StyleGAN Edit Directions
The success of StyleGAN has enabled unprecedented semantic editing capabilities, on both synthesized and real images. However, such editing operations are either trained with semantic supervision or described using human…
Zero-Shot LearningRepurposing Stable Diffusion Attention for Training-Free Unsupervised Interactive Segmentation
Recent progress in interactive point prompt based Image Segmentation allows to significantly reduce the manual effort to obtain high quality semantic labels. State-of-the-art unsupervised methods use self-supervised pre-…
Image SegmentationInteractive SegmentationSegmentationSemantic SegmentationFreePoint: Unsupervised Point Cloud Instance Segmentation
Instance segmentation of point clouds is a crucial task in 3D field with numerous applications that involve localizing and segmenting objects in a scene. However, achieving satisfactory results requires a large number of…
Instance SegmentationSegmentationSemantic SegmentationUnsupervised Pre-trainingSegmentation in Style: Unsupervised Semantic Image Segmentation with Stylegan and CLIP
We introduce a method that allows to automatically segment images into semantically meaningful regions without human supervision. Derived regions are consistent across different images and coincide with human-defined sem…
Image SegmentationSegmentationSemantic SegmentationUnsupervised Camouflaged Object Segmentation as Domain Adaptation
Deep learning for unsupervised image segmentation remains challenging due to the absence of human labels. The common idea is to train a segmentation head, with the supervision of pixel-wise pseudo-labels generated based …
AttributeCamouflaged Object SegmentationDomain AdaptationImage Segmentation+5