Retrieval-based Localization Based on Domain-invariant Feature Learning under Changing Environments
Visual localization is a crucial problem in mobile robotics and autonomous driving. One solution is to retrieve images with known pose from a database for the localization of query images. However, in environments with drastically varying conditions (e.g. illumination changes, seasons, occlusion, dynamic objects), retrieval-based localization is severely hampered and becomes a challenging problem. In this paper, a novel domain-invariant feature learning method (DIFL) is proposed based on ComboGAN, a multi-domain image translation network architecture. By introducing a feature consistency loss (FCL) between the encoded features of the original image and translated image in another domain, we are able to train the encoders to generate domain-invariant features in a self-supervised manner. To retrieve a target image from the database, the query image is first encoded using the encoder belonging to the query domain to obtain a domain-invariant feature vector. We then preform retrieval by selecting the database image with the most similar domain-invariant feature vector. We validate the proposed approach on the CMU-Seasons dataset, where we outperform state-of-the-art learning-based descriptors in retrieval-based localization for high and medium precision scenarios.
Code (1)
Tasks
Autonomous DrivingRetrievalTranslationVisual LocalizationSimilar Papers 제목 키워드 기반
Domain-invariant Similarity Activation Map Contrastive Learning for Retrieval-based Long-term Visual Localization
Visual localization is a crucial component in the application of mobile robot and autonomous driving. Image retrieval is an efficient and effective technique in image-based localization methods. Due to the drastic variab…
Autonomous DrivingContrastive LearningImage-Based LocalizationImage Retrieval+4Learning Condition Invariant Features for Retrieval-Based Localization from 1M Images
Image features for retrieval-based localization must be invariant to dynamic objects (e.g. cars) as well as seasonal and daytime changes. Such invariances are, up to some extent, learnable with existing methods using tri…
RetrievalTripleti3dLoc: Image-to-range Cross-domain Localization Robust to Inconsistent Environmental Conditions
We present a method for localizing a single camera with respect to a point cloud map in indoor and outdoor scenes. The problem is challenging because correspondences of local invariant features are inconsistent across th…
3D geometryGenerative Adversarial NetworkVisual LocalizationLong-Term Invariant Local Features via Implicit Cross-Domain Correspondences
Modern learning-based visual feature extraction networks perform well in intra-domain localization, however, their performance significantly declines when image pairs are captured across long-term visual domain variation…
Visual LocalizationSphereVLAD++: Attention-based and Signal-enhanced Viewpoint Invariant Descriptor
LiDAR-based localization approach is a fundamental module for large-scale navigation tasks, such as last-mile delivery and autonomous driving, and localization robustness highly relies on viewpoints and 3D feature extrac…
3D geometry3D Place RecognitionAutonomous DrivingRetrieval