Has Anything Changed? 3D Change Detection by 2D Segmentation Masks
As capturing devices become common, 3D scans of interior spaces are acquired on a daily basis. Through scene comparison over time, information about objects in the scene and their changes is inferred. This information is important for robots and AR and VR devices, in order to operate in an immersive virtual experience. We thus propose an unsupervised object discovery method that identifies added, moved, or removed objects without any prior knowledge of what objects exist in the scene. We model this problem as a combination of a 3D change detection and a 2D segmentation task. Our algorithm leverages generic 2D segmentation masks to refine an initial but incomplete set of 3D change detections. The initial changes, acquired through render-and-compare likely correspond to movable objects. The incomplete detections are refined through graph optimization, distilling the information of the 2D segmentation masks in the 3D space. Experiments on the 3Rscan dataset prove that our method outperforms competitive baselines, with SoTA results.
Code (0)
등록된 구현이 없습니다.
Tasks
Change DetectionObject DiscoverySegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MergeSAM: Unsupervised change detection of remote sensing images based on the Segment Anything Model
Recently, large foundation models trained on vast datasets have demonstrated exceptional capabilities in feature extraction and general feature representation. The ongoing advancements in deep learning-driven large model…
Object SegmentationChange DetectionUnsupervised Change Detection Based on Image Reconstruction Loss with Segment Anything
In remote sensing, change detection based on deep learning shows promising performance. However, collecting multi-temporal paired images for training a change detection model is costly. To solve this problem, unsupervise…
Change DetectionImage ReconstructionZero-Shot Edge Detection with SCESAME: Spectral Clustering-based Ensemble for Segment Anything Model Estimation
This paper proposes a novel zero-shot edge detection with SCESAME, which stands for Spectral Clustering-based Ensemble for Segment Anything Model Estimation, based on the recently proposed Segment Anything Model (SAM). S…
ClusteringEdge DetectionZero Shot SegmentationSAM-Based Building Change Detection with Distribution-Aware Fourier Adaptation and Edge-Constrained Warping
Building change detection remains challenging for urban development, disaster assessment, and military reconnaissance. While foundation models like Segment Anything Model (SAM) show strong segmentation capabilities, SAM …
Change DetectionOptical Flow EstimationSegment Anything is A Good Pseudo-label Generator for Weakly Supervised Semantic Segmentation
Weakly supervised semantic segmentation with weak labels is a long-lived ill-posed problem. Mainstream methods mainly focus on improving the quality of pseudo labels. In this report, we attempt to explore the potential o…
Pseudo LabelSegmentationSemantic SegmentationWeakly supervised Semantic Segmentation+1