Patch-NetVLAD+: Learned patch descriptor and weighted matching strategy for place recognition
Visual Place Recognition (VPR) in areas with similar scenes such as urban or indoor scenarios is a major challenge. Existing VPR methods using global descriptors have difficulty capturing local specific regions (LSR) in the scene and are therefore prone to localization confusion in such scenarios. As a result, finding the LSR that are critical for location recognition becomes key. To address this challenge, we introduced Patch-NetVLAD+, which was inspired by patch-based VPR researches. Our method proposed a fine-tuning strategy with triplet loss to make NetVLAD suitable for extracting patch-level descriptors. Moreover, unlike existing methods that treat all patches in an image equally, our method extracts patches of LSR, which present less frequently throughout the dataset, and makes them play an important role in VPR by assigning proper weights to them. Experiments on Pittsburgh30k and Tokyo247 datasets show that our approach achieved up to 6.35\% performance improvement than existing patch-based methods.
Code (0)
등록된 구현이 없습니다.
Tasks
TripletVisual Place RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition
Visual Place Recognition is a challenging task for robotics and autonomous systems, which must deal with the twin problems of appearance and viewpoint change in an always changing world. This paper introduces Patch-NetVL…
Computational EfficiencyVisual LocalizationVisual Place RecognitionA Faster, Lighter and Stronger Deep Learning-Based Approach for Place Recognition
Visual Place Recognition is an essential component of systems for camera localization and loop closure detection, and it has attracted widespread interest in multiple domains such as computer vision, robotics and AR/VR. …
Camera LocalizationLoop Closure DetectionVisual Place RecognitionSOWP: Spatially Ordered and Weighted Patch Descriptor for Visual Tracking
A simple yet effective object descriptor for visual tracking is proposed in this paper. We first decompose the bounding box of a target object into multiple patches, which are described by color and gradient histograms. …
ObjectVisual TrackingMultiRes-NetVLAD: Augmenting Place Recognition Training with Low-Resolution Imagery
Visual Place Recognition (VPR) is a crucial component of 6-DoF localization, visual SLAM and structure-from-motion pipelines, tasked to generate an initial list of place match hypotheses by matching global place descript…
BenchmarkingRepresentation LearningRetrievalVisual Place RecognitionTowards Implicit Aggregation: Robust Image Representation for Place Recognition in the Transformer Era
Visual place recognition (VPR) is typically regarded as a specific image retrieval task, whose core lies in representing images as global descriptors. Over the past decade, dominant VPR methods (e.g., NetVLAD) have follo…
Visual Place RecognitionImage Retrieval