paper-with-me

홈 › Papers

Learning Condition Invariant Features for Retrieval-Based Localization from 1M Images

2020-08-27 · Janine Thoma, Danda Pani Paudel, Ajad Chhatkuli, Luc van Gool

Image features for retrieval-based localization must be invariant to dynamic objects (e.g. cars) as well as seasonal and daytime changes. Such invariances are, up to some extent, learnable with existing methods using triplet-like losses, given a large number of diverse training images. However, due to the high algorithmic training complexity, there exists insufficient comparison between different loss functions on large datasets. In this paper, we train and evaluate several localization methods on three different benchmark datasets, including Oxford RobotCar with over one million images. This large scale evaluation yields valuable insights into the generalizability and performance of retrieval-based localization. Based on our findings, we develop a novel method for learning more accurate and better generalizing localization features. It consists of two main contributions: (i) a feature volume-based loss function, and (ii) hard positive and pairwise negative mining. On the challenging Oxford RobotCar night condition, our method outperforms the well-known triplet loss by 24.4% in localization accuracy within 5m.

📄 PDF Abstract BibTeX arXiv:2008.12165

Code (1)

janinethoma/learning1M 공식 구현 tf

Tasks

RetrievalTriplet

Methods 이 논문이 사용한 방법론

Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…

Similar Papers 제목 키워드 기반

Retrieval-based Localization Based on Domain-invariant Feature Learning under Changing Environments

2019-09-23 · Hanjiang Hu, Hesheng Wang, Zhe Liu, Chenguang Yang 외

Visual localization is a crucial problem in mobile robotics and autonomous driving. One solution is to retrieve images with known pose from a database for the localization of query images. However, in environments with d…

Autonomous DrivingRetrievalTranslationVisual Localization

i3dLoc: Image-to-range Cross-domain Localization Robust to Inconsistent Environmental Conditions

2021-05-27 · Peng Yin, Lingyun Xu, Ji Zhang, Howie Choset 외

We present a method for localizing a single camera with respect to a point cloud map in indoor and outdoor scenes. The problem is challenging because correspondences of local invariant features are inconsistent across th…

3D geometryGenerative Adversarial NetworkVisual Localization

Domain-invariant Similarity Activation Map Contrastive Learning for Retrieval-based Long-term Visual Localization

2020-09-16 · Hanjiang Hu, Hesheng Wang, Zhe Liu, Weidong Chen

Visual localization is a crucial component in the application of mobile robot and autonomous driving. Image retrieval is an efficient and effective technique in image-based localization methods. Due to the drastic variab…

Autonomous DrivingContrastive LearningImage-Based LocalizationImage Retrieval+4

REST: Real-to-Synthetic Transform for Illumination Invariant Camera Localization

2018-03-26 · Sota Shoman, Tomohiro Mashita, Alexander Plopski, Photchara Ratsamee 외

Accurate camera localization is an essential part of tracking systems. However, localization results are greatly affected by illumination. Including data collected under various lighting conditions can improve the robust…

Camera Localization

Geometrically Mappable Image Features

2020-03-21 · Janine Thoma, Danda Pani Paudel, Ajad Chhatkuli, Luc van Gool

Vision-based localization of an agent in a map is an important problem in robotics and computer vision. In that context, localization by learning matchable image features is gaining popularity due to recent advances in m…

Image RetrievalRetrieval