Multi-Object Representation Learning via Feature Connectivity and Object-Centric Regularization
Discovering object-centric representations from images has the potential to greatly improve the robustness, sample efficiency and interpretability of machine learning algorithms. Current works on multi-object images typically follow a generative approach that optimizes for input reconstruction and fail to scale to real-world datasets despite significant increases in model capacity. We address this limitation by proposing a novel method that leverages feature connectivity to cluster neighboring pixels likely to belong to the same object. We further design two object-centric regularization terms to refine object representations in the latent space, enabling our approach to scale to complex real-world images. Experimental results on simulated, real-world, complex texture and common object images demonstrate a substantial improvement in the quality of discovered objects compared to state-of-the-art methods, as well as the sample efficiency and generalizability of our approach. We also show that the discovered object-centric representations can accurately predict key object properties in downstream tasks, highlighting the potential of our method to advance the field of multi-object representation learning.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
BiconNet: An Edge-preserved Connectivity-based Approach for Salient Object Detection
Salient object detection (SOD) is viewed as a pixel-wise saliency modeling task by traditional deep learning-based methods. A limitation of current SOD models is insufficient utilization of inter-pixel information, which…
object-detectionObject DetectionSalient Object DetectionV1Net: A computational model of cortical horizontal connections
The primate visual system builds robust, multi-purpose representations of the external world in order to support several diverse downstream cortical processes. Such representations are required to be invariant to the sen…
Boundary DetectionmodelObject RecognitionConnectivity Maintenance: Global and Optimized approach through Control Barrier Functions
Connectivity maintenance is an essential aspect to consider while controlling a multi-robot system. In general, a multi-robot system should be connected to obtain a certain common objective. Connectivity must be kept reg…
Visual Tracking via Boolean Map Representations
In this paper, we present a simple yet effective Boolean map based representation that exploits connectivity cues for visual tracking. We describe a target object with histogram of oriented gradients and raw color featur…
Visual TrackingAmodal 3D Reconstruction for Robotic Manipulation via Stability and Connectivity
Learning-based 3D object reconstruction enables single- or few-shot estimation of 3D object models. For robotics, this holds the potential to allow model-based methods to rapidly adapt to novel objects and scenes. Existi…
3D Object Reconstruction3D ReconstructionObjectObject Reconstruction