Cross-Descriptor Visual Localization and Mapping
Visual localization and mapping is the key technology underlying the majority of mixed reality and robotics systems. Most state-of-the-art approaches rely on local features to establish correspondences between images. In this paper, we present three novel scenarios for localization and mapping which require the continuous update of feature representations and the ability to match across different feature types. While localization and mapping is a fundamental computer vision problem, the traditional setup supposes the same local features are used throughout the evolution of a map. Thus, whenever the underlying features are changed, the whole process is repeated from scratch. However, this is typically impossible in practice, because raw images are often not stored and re-building the maps could lead to loss of the attached digital content. To overcome the limitations of current approaches, we present the first principled solution to cross-descriptor localization and mapping. Our data-driven approach is agnostic to the feature descriptor type, has low computational requirements, and scales linearly with the number of description algorithms. Extensive experiments demonstrate the effectiveness of our approach on state-of-the-art benchmarks for a variety of handcrafted and learned features.
Code (1)
Tasks
Mixed RealityVisual LocalizationSimilar Papers 제목 키워드 기반
Representing 3D sparse map points and lines for camera relocalization
Recent advancements in visual localization and mapping have demonstrated considerable success in integrating point and line features. However, expanding the localization framework to include additional mapping components…
Camera RelocalizationIndoor LocalizationOutdoor LocalizationVisual LocalizationAppearance-based indoor localization: A comparison of patch descriptor performance
Vision is one of the most important of the senses, and humans use it extensively during navigation. We evaluated different types of image and video frame descriptors that could be used to determine distinctive visual lan…
Indoor LocalizationPositionSimultaneous Localization and MappingMonocular Visual Place Recognition in LiDAR Maps via Cross-Modal State Space Model and Multi-View Matching
Achieving monocular camera localization within pre-built LiDAR maps can bypass the simultaneous mapping process of visual SLAM systems, potentially reducing the computational overhead of autonomous localization. To this …
Camera LocalizationContrastive LearningCross-modal place recognitionVisual Place RecognitionZippyPoint: Fast Interest Point Detection, Description, and Matching through Mixed Precision Discretization
Efficient detection and description of geometric regions in images is a prerequisite in visual systems for localization and mapping. Such systems still rely on traditional hand-crafted methods for efficient generation of…
Homography EstimationInterest Point DetectionQuantizationVisual LocalizationScene Retrieval for Contextual Visual Mapping
Visual navigation localizes a query place image against a reference database of place images, also known as a `visual map'. Localization accuracy requirements for specific areas of the visual map, `scene classes', vary a…
General ClassificationImage RetrievalRetrievalScene Classification+3