Fine-Grained Change Detection of Misaligned Scenes With Varied Illuminations
Detecting fine-grained subtle changes among a scene is critically important in practice. Previous change detection methods, focusing on detecting large-scale significant changes, cannot do this well. This paper proposes a feasible end-to-end approach to this challenging problem. We start from active camera relocation that quickly relocates camera to nearly the same pose and position of the last time observation. To guarantee detection sensitivity and accuracy of minute changes, in an observation, we capture a group of images under multiple illuminations, which need only to be roughly aligned to the last time lighting conditions. Given two times observations, we formulate fine-grained change detection as a joint optimization problem of three related factors, i.e., normal-aware lighting difference, camera geometry correction flow, and real scene change mask. We solve the three factors in a coarse-to-fine manner and achieve reliable change decision by rank minimization. We build three real-world datasets to benchmark fine-grained change detection of misaligned scenes under varied multiple lighting conditions. Extensive experiments show the superior performance of our approach over state-of-the-art change detection methods and its ability to distinguish real scene changes from false ones caused by lighting variations.
Code (0)
등록된 구현이 없습니다.
Tasks
Change DetectionSimilar Papers 제목 키워드 기반
Active Lighting Recurrence by Parallel Lighting Analogy for Fine-Grained Change Detection
This paper studies a new problem, namely active lighting recurrence (ALR) that physically relocalizes a light source to reproduce the lighting condition from single reference image for a same scene, which may suffer from…
Change DetectionNavigateAn Active and Contrastive Learning Framework for Fine-Grained Off-Road Semantic Segmentation
Off-road semantic segmentation with fine-grained labels is necessary for autonomous vehicles to understand driving scenes, as the coarse-grained road detection can not satisfy off-road vehicles with various mechanical pr…
Autonomous VehiclesContrastive LearningSegmentationSemantic SegmentationIllumination-Invariant Active Camera Relocalization for Fine-Grained Change Detection in the Wild
Active camera relocalization (ACR) is a new problem in computer vision that significantly reduces the false alarm caused by image distortions due to camera pose misalignment in fine-grained change detection (FGCD). Despi…
Camera RelocalizationChange DetectionPose EstimationGCD-DDPM: A Generative Change Detection Model Based on Difference-Feature Guided DDPM
Deep learning (DL)-based methods have recently shown great promise in bitemporal change detection (CD). Existing discriminative methods based on Convolutional Neural Networks (CNNs) and Transformers rely on discriminativ…
Change DetectionDenoisingRepresentation LearningVariational InferenceEA-LSS: Edge-aware Lift-splat-shot Framework for 3D BEV Object Detection
In recent years, great progress has been made in the Lift-Splat-Shot-based (LSS-based) 3D object detection method. However, inaccurate depth estimation remains an important constraint to the accuracy of camera-only and m…
3D Object DetectionDepth EstimationObjectobject-detection+1