Unsupervised Multi-object Segmentation Using Attention and Soft-argmax
We introduce a new architecture for unsupervised object-centric representation learning and multi-object detection and segmentation, which uses a translation-equivariant attention mechanism to predict the coordinates of the objects present in the scene and to associate a feature vector to each object. A transformer encoder handles occlusions and redundant detections, and a convolutional autoencoder is in charge of background reconstruction. We show that this architecture significantly outperforms the state of the art on complex synthetic benchmarks.
Code (1)
Tasks
Objectobject-detectionObject DetectionRepresentation LearningSemantic SegmentationTranslationUnsupervised Object SegmentationSimilar Papers 제목 키워드 기반
Labels4Free: Unsupervised Segmentation using StyleGAN
We propose an unsupervised segmentation framework for StyleGAN generated objects. We build on two main observations. First, the features generated by StyleGAN hold valuable information that can be utilized towards traini…
SegmentationDiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cut
Foundation models have emerged as powerful tools across various domains including language, vision, and multimodal tasks. While prior works have addressed unsupervised image segmentation, they significantly lag behind su…
Image SegmentationSegmentationSemantic SegmentationUnsupervised Image Segmentation+3Learning Unsupervised Video Object Segmentation Through Visual Attention
This paper conducts a systematic study on the role of visual attention in Unsupervised Video Object Segmentation (UVOS) tasks. By elaborately annotating three popular video segmentation datasets (DAVIS, Youtube-Objects a…
ObjectSegmentationSemantic SegmentationUnsupervised Video Object Segmentation+3Unsupervised Musical Object Discovery from Audio
Current object-centric learning models such as the popular SlotAttention architecture allow for unsupervised visual scene decomposition. Our novel MusicSlots method adapts SlotAttention to the audio domain, to achieve un…
ObjectObject DiscoveryProperty PredictionDual Prototype Attention for Unsupervised Video Object Segmentation
Unsupervised video object segmentation (VOS) aims to detect and segment the most salient object in videos. The primary techniques used in unsupervised VOS are 1) the collaboration of appearance and motion information; an…
ObjectSemantic SegmentationUnsupervised Video Object SegmentationVideo Object Segmentation+1