Privacy Preserving Image-Based Localization
Image-based localization is a core component of many augmented/mixed reality (AR/MR) and autonomous robotic systems. Current localization systems rely on the persistent storage of 3D point clouds of the scene to enable camera pose estimation, but such data reveals potentially sensitive scene information. This gives rise to significant privacy risks, especially as for many applications 3D mapping is a background process that the user might not be fully aware of. We pose the following question: How can we avoid disclosing confidential information about the captured 3D scene, and yet allow reliable camera pose estimation? This paper proposes the first solution to what we call privacy preserving image-based localization. The key idea of our approach is to lift the map representation from a 3D point cloud to a 3D line cloud. This novel representation obfuscates the underlying scene geometry while providing sufficient geometric constraints to enable robust and accurate 6-DOF camera pose estimation. Extensive experiments on several datasets and localization scenarios underline the high practical relevance of our proposed approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera Pose EstimationImage-Based LocalizationMixed RealityPose EstimationPrivacy PreservingSimilar Papers 제목 키워드 기반
Privacy-Preserving Structureless Visual Localization via Image Obfuscation
Visual localization is the task of estimating the camera pose of an image relative to a scene representation. In practice, visual localization systems are often cloud-based. Naturally, this raises privacy concerns in ter…
Visual LocalizationPrivacy Preserving Localization via Coordinate Permutations
Recent methods on privacy-preserving image-based localization use a random line parameterization to protect the privacy of query images and database maps. The lifting of points to lines effectively drops one of the t…
Image-Based LocalizationPose EstimationPrivacy PreservingGaussian Splatting Feature Fields for Privacy-Preserving Visual Localization
Visual localization is the task of estimating a camera pose in a known environment. In this paper, we utilize 3D Gaussian Splatting (3DGS)-based representations for accurate and privacy-preserving visual localization. We…
Representation LearningVisual LocalizationGaussian Splatting Feature Fields for (Privacy-Preserving) Visual Localization
Visual localization is the task of estimating a camera pose in a known environment. In this paper, we utilize 3D Gaussian Splatting (3DGS)-based representations for accurate and privacy-preserving visual localization…
3DGSPrivacy PreservingRepresentation LearningVisual LocalizationPrivacy Preserving Localization and Mapping From Uncalibrated Cameras
Recent works on localization and mapping from privacy preserving line features have made significant progress towards addressing the privacy concerns arising from cloud-based solutions in mixed reality and robotics. …
Mixed RealityPrivacy Preserving