Multi-Object Discovery by Low-Dimensional Object Motion
Recent work in unsupervised multi-object segmentation shows impressive results by predicting motion from a single image despite the inherent ambiguity in predicting motion without the next image. On the other hand, the set of possible motions for an image can be constrained to a low-dimensional space by considering the scene structure and moving objects in it. We propose to model pixel-wise geometry and object motion to remove ambiguity in reconstructing flow from a single image. Specifically, we divide the image into coherently moving regions and use depth to construct flow bases that best explain the observed flow in each region. We achieve state-of-the-art results in unsupervised multi-object segmentation on synthetic and real-world datasets by modeling the scene structure and object motion. Our evaluation of the predicted depth maps shows reliable performance in monocular depth estimation.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationMonocular Depth EstimationMulti-object discoveryObjectObject DiscoverySegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Motion-Refined DINOSAUR for Unsupervised Multi-Object Discovery
Unsupervised multi-object discovery (MOD) aims to detect and localize distinct object instances in visual scenes without any form of human supervision. Recent approaches leverage object-centric learning (OCL) and motion …
Multi-object discoveryMotion SegmentationCross-Modal Distillation for 2D/3D Multi-Object Discovery from 2D Motion
Object discovery, which refers to the task of localizing objects without human annotations, has gained significant attention in 2D image analysis. However, despite this growing interest, it remains under-explored in …
Multi-object discoveryObjectObject DiscoveryObject LocalizationxMOD: Cross-Modal Distillation for 2D/3D Multi-Object Discovery from 2D motion
Object discovery, which refers to the task of localizing objects without human annotations, has gained significant attention in 2D image analysis. However, despite this growing interest, it remains under-explored in 3D d…
Multi-object discoveryObjectObject DiscoveryObject LocalizationThe Background Also Matters: Background-Aware Motion-Guided Objects Discovery
Recent works have shown that objects discovery can largely benefit from the inherent motion information in video data. However, these methods lack a proper background processing, resulting in an over-segmentation of the …
ObjectObject DiscoveryOptical Flow EstimationObject Discovery in Videos as Foreground Motion Clustering
We consider the problem of providing dense segmentation masks for object discovery in videos. We formulate the object discovery problem as foreground motion clustering, where the goal is to cluster foreground pixels in v…
ClusteringMotion SegmentationObjectObject Discovery+2