MOVE: Unsupervised Movable Object Segmentation and Detection
We introduce MOVE, a novel method to segment objects without any form of supervision. MOVE exploits the fact that foreground objects can be shifted locally relative to their initial position and result in realistic (undistorted) new images. This property allows us to train a segmentation model on a dataset of images without annotation and to achieve state of the art (SotA) performance on several evaluation datasets for unsupervised salient object detection and segmentation. In unsupervised single object discovery, MOVE gives an average CorLoc improvement of 7.2% over the SotA, and in unsupervised class-agnostic object detection it gives a relative AP improvement of 53% on average. Our approach is built on top of self-supervised features (e.g. from DINO or MAE), an inpainting network (based on the Masked AutoEncoder) and adversarial training.
Code (1)
Tasks
Class-agnostic Object DetectionObjectobject-detectionObject DetectionObject DiscoveryPositionSalient Object DetectionSegmentationSemantic SegmentationSingle-object discoveryUnsupervised Saliency DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MOVES: Movable and Moving LiDAR Scene Segmentation in Label-Free settings using Static Reconstruction
Accurate static structure reconstruction and segmentation of non-stationary objects is of vital importance for autonomous navigation applications. These applications assume a LiDAR scan to consist of only static structur…
Autonomous NavigationScene SegmentationSegmentationHas Anything Changed? 3D Change Detection by 2D Segmentation Masks
As capturing devices become common, 3D scans of interior spaces are acquired on a daily basis. Through scene comparison over time, information about objects in the scene and their changes is inferred. This information is…
Change DetectionObject DiscoverySegmentationInteractMove: Text-Controlled Human-Object Interaction Generation in 3D Scenes with Movable Objects
We propose a novel task of text-controlled human object interaction generation in 3D scenes with movable objects. Existing human-scene interaction datasets suffer from insufficient interaction categories and typically on…
Collision AvoidanceVisual GroundingUnsupervised Online Video Object Segmentation with Motion Property Understanding
Unsupervised video object segmentation aims to automatically segment moving objects over an unconstrained video without any user annotation. So far, only few unsupervised online methods have been reported in literature a…
Motion DetectionObjectSegmentationSemantic Segmentation+3Detection and Tracking of General Movable Objects in Large 3D Maps
This paper studies the problem of detection and tracking of general objects with long-term dynamics, observed by a mobile robot moving in a large environment. A key problem is that due to the environment scale, it can on…