Changes in Real Time: Online Scene Change Detection with Multi-View Fusion
Online Scene Change Detection (SCD) is an extremely challenging problem that requires an agent to detect relevant changes on the fly while observing the scene from unconstrained viewpoints. Existing online SCD methods are significantly less accurate than offline approaches. We present the first online SCD approach that is pose-agnostic, label-free, and ensures multi-view consistency, while operating at over 10 FPS and achieving new state-of-the-art performance, surpassing even the best offline approaches. Our method introduces a new self-supervised fusion loss to infer scene changes from multiple cues and observations, PnP-based fast pose estimation against the reference scene, and a fast change-guided update strategy for the 3D Gaussian Splatting scene representation. Extensive experiments on complex real-world datasets demonstrate that our approach outperforms both online and offline baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Scene Change DetectionPose EstimationSimilar Papers 제목 키워드 기반
Online Geometric Change Detection via Scene Decomposition
Autonomous robots are increasingly deployed on long duration single- and multi-session missions in dynamic environments, where the ability to identify environmental changes such as fallen trees or opened doors provides i…
Change DetectionChangeSim: Towards End-to-End Online Scene Change Detection in Industrial Indoor Environments
We present a challenging dataset, ChangeSim, aimed at online scene change detection (SCD) and more. The data is collected in photo-realistic simulation environments with the presence of environmental non-targeted variati…
Change DetectionScene Change DetectionSegmentationSemantic SegmentationChange Blindness in 3D Virtual Reality
In the present change blindness study subjects explored stereoscopic three dimensional (3D) environments through a virtual reality (VR) headset. A novel method that tracked the subjects' head movements was used for induc…
Change DetectionAOL: Adaptive Online Learning for Human Trajectory Prediction in Dynamic Video Scenes
We present a novel adaptive online learning (AOL) framework to predict human movement trajectories in dynamic video scenes. Our framework learns and adapts to changes in the scene environment and generates best network w…
PredictionTrajectory PredictionRobust Person Following Under Severe Indoor Illumination Changes for Mobile Robots: Online Color-Based Identification Update
Tracking a specific person in environments with non-uniform illumination is a difficult task for mobile robots. Image information such as color is essential to identify a target person. However, the information is not re…
Person Identification