Efficient Privacy-Preserving Visual Localization Using 3D Ray Clouds
The recent success in revealing scene details from sparse 3D point clouds obtained via structure-from-motion has raised significant privacy concerns in visual localization. One prominent approach for mitigating this issue is to lift 3D points to 3D lines thereby reducing the effectiveness of the scene inversion attacks but this comes at the cost of increased algorithmic complexity for camera localization due to weaker geometric constraints induced by line clouds. To overcome this limitation we propose a new lifting approach called "ray cloud" whereby each lifted 3D line intersects at one of two predefined locations depicting omnidirectional rays from two cameras. This yields two benefits i) camera localization can now be cast as relative pose estimation between the query image and the calibrated rig of two perspective cameras which can be efficiently solved using a variant of the 5-point algorithm and ii) the ray cloud introduces erroneous estimations for the density-based inversion attack degrading the quality of scene recovery. Moreover we explore possible modifications of the inversion attack to better recover scenes from the ray clouds and propose a ray sampling technique to reduce the effectiveness of the modified attack. Experimental results on two public datasets show real-time localization speed as well as enhanced privacy-preserving capability over the state-of-the-art without overly sacrificing the localization accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera LocalizationPose EstimationPrivacy PreservingVisual LocalizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Depth-Guided Privacy-Preserving Visual Localization Using 3D Sphere Clouds
The emergence of deep neural networks capable of revealing high-fidelity scene details from sparse 3D point clouds has raised significant privacy concerns in visual localization involving private maps. Lifting map points…
Camera Pose EstimationVisual LocalizationPoint CloudsPrivacy Preserving Visual SLAM
This study proposes a privacy-preserving Visual SLAM framework for estimating camera poses and performing bundle adjustment with mixed line and point clouds in real time. Previous studies have proposed localization metho…
Computational EfficiencyPrivacy PreservingHow Privacy-Preserving are Line Clouds? Recovering Scene Details from 3D Lines
Visual localization is the problem of estimating the camera pose of a given image with respect to a known scene. Visual localization algorithms are a fundamental building block in advanced computer vision applications, i…
Camera Pose EstimationPose EstimationPrivacy PreservingTranslation+1Paired-Point Lifting for Enhanced Privacy-Preserving Visual Localization
Visual localization refers to the process of recovering camera pose from input image relative to a known scene, forming a cornerstone of numerous vision and robotics systems. While many algorithms utilize sparse 3D p…
feature selectionPrivacy PreservingVisual LocalizationPrivacy Preserving Partial Localization
Recently proposed privacy preserving solutions for cloud-based localization rely on lifting traditional point-based maps to randomized 3D line clouds. While the lifted representation is effective in concealing privat…
Privacy Preserving