paper-with-me

홈 › Papers

Global Proxy-based Hard Mining for Visual Place Recognition

2023-02-28 · Amar Ali-bey, Brahim Chaib-Draa, Philippe Giguère

Learning deep representations for visual place recognition is commonly performed using pairwise or triple loss functions that highly depend on the hardness of the examples sampled at each training iteration. Existing techniques address this by using computationally and memory expensive offline hard mining, which consists of identifying, at each iteration, the hardest samples from the training set. In this paper we introduce a new technique that performs global hard mini-batch sampling based on proxies. To do so, we add a new end-to-end trainable branch to the network, which generates efficient place descriptors (one proxy for each place). These proxy representations are thus used to construct a global index that encompasses the similarities between all places in the dataset, allowing for highly informative mini-batch sampling at each training iteration. Our method can be used in combination with all existing pairwise and triplet loss functions with negligible additional memory and computation cost. We run extensive ablation studies and show that our technique brings new state-of-the-art performance on multiple large-scale benchmarks such as Pittsburgh, Mapillary-SLS and SPED. In particular, our method provides more than 100% relative improvement on the challenging Nordland dataset. Our code is available at https://github.com/amaralibey/GPM

📄 PDF Abstract BibTeX arXiv:2302.14217

Code (1)

amaralibey/gpm 공식 구현

Tasks

Image RetrievalImage Similarity SearchMetric LearningTripletVisual Place Recognition

Methods 이 논문이 사용한 방법론

Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…

Similar Papers 제목 키워드 기반

Efficient 3D Point Cloud Feature Learning for Large-Scale Place Recognition

2021-01-07 · Le Hui, Mingmei Cheng, Jin Xie, Jian Yang

Point cloud based retrieval for place recognition is still a challenging problem due to drastic appearance and illumination changes of scenes in changing environments. Existing deep learning based global descriptors for …

Point Cloud RetrievalRetrievalVisual Place Recognition

AANet: Aggregation and Alignment Network with Semi-hard Positive Sample Mining for Hierarchical Place Recognition

2023-10-08 · Feng Lu, Lijun Zhang, Shuting Dong, Baifan Chen 외

Visual place recognition (VPR) is one of the research hotspots in robotics, which uses visual information to locate robots. Recently, the hierarchical two-stage VPR methods have become popular in this field due to the tr…

Re-RankingTripletVisual Place Recognition

xSIM++: An Improved Proxy to Bitext Mining Performance for Low-Resource Languages

2023-06-22 · Mingda Chen, Kevin Heffernan, Onur Çelebi, Alex Mourachko 외

We introduce a new proxy score for evaluating bitext mining based on similarity in a multilingual embedding space: xSIM++. In comparison to xSIM, this improved proxy leverages rule-based approaches to extend English sent…

NMT

Data-efficient Large Scale Place Recognition with Graded Similarity Supervision

2023-03-21 · CVPR 2023 1 · Maria Leyva-Vallina, Nicola Strisciuglio, Nicolai Petkov

Visual place recognition (VPR) is a fundamental task of computer vision for visual localization. Existing methods are trained using image pairs that either depict the same place or not. Such a binary indication does not …

Re-RankingVisual LocalizationVisual Place Recognition

SAGE: Spatial-visual Adaptive Graph Exploration for Efficient Visual Place Recognition

2025-09-30 · Shunpeng Chen, Changwei Wang, Rongtao Xu, Xingtian Pei 외 arxiv

Visual Place Recognition (VPR) requires robust retrieval of geotagged images despite large appearance, viewpoint, and environmental variation. Prior methods focus on descriptor fine-tuning or fixed sampling strategies ye…

parameter-efficient fine-tuningVisual Place Recognition