Reflect3r: Single-View 3D Stereo Reconstruction Aided by Mirror Reflections
Mirror reflections are common in everyday environments and can provide stereo information within a single capture, as the real and reflected virtual views are visible simultaneously. We exploit this property by treating the reflection as an auxiliary view and designing a transformation that constructs a physically valid virtual camera, allowing direct pixel-domain generation of the virtual view while adhering to the real-world imaging process. This enables a multi-view stereo setup from a single image, simplifying the imaging process, making it compatible with powerful feed-forward reconstruction models for generalizable and robust 3D reconstruction. To further exploit the geometric symmetry introduced by mirrors, we propose a symmetric-aware loss to refine pose estimation. Our framework also naturally extends to dynamic scenes, where each frame contains a mirror reflection, enabling efficient per-frame geometry recovery. For quantitative evaluation, we provide a fully customizable synthetic dataset of 16 Blender scenes, each with ground-truth point clouds and camera poses. Extensive experiments on real-world data and synthetic data are conducted to illustrate the effectiveness of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionPose EstimationPoint CloudsSimilar Papers 제목 키워드 기반
RNb-NeuS: Reflectance and Normal-based Multi-View 3D Reconstruction
This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance…
3D ReconstructionMulti-View 3D ReconstructionMulti-view Photometric Stereo with Spatially Varying Isotropic Materials
We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo technique that works for general isotropic materials. Our data capture setup is simple, which consists o…
Appearance and Shape from Water Reflection
This paper introduces single-image geometric and appearance reconstruction from water reflection photography, i.e., images capturing direct and water-reflected real-world scenes. Water reflection offers an additional vie…
3D Scene ReconstructionStereo MatchingStereo Matching HandLearning to Detect 3D Reflection Symmetry for Single-View Reconstruction
3D reconstruction from a single RGB image is a challenging problem in computer vision. Previous methods are usually solely data-driven, which lead to inaccurate 3D shape recovery and limited generalization capability. In…
3D ReconstructionSingle-View 3D ReconstructionLearned Dual-View Reflection Removal
Traditional reflection removal algorithms either use a single image as input, which suffers from intrinsic ambiguities, or use multiple images from a moving camera, which is inconvenient for users. We instead propose a l…
Reflection Removal