paper-with-me

Papers

StructVPR++: Distill Structural and Semantic Knowledge with Weighting Samples for Visual Place Recognition

2025-03-09 · Yanqing Shen, Sanping Zhou, Jingwen Fu, Ruotong Wang, Shitao Chen, Nanning Zheng

Visual place recognition is a challenging task for autonomous driving and robotics, which is usually considered as an image retrieval problem. A commonly used two-stage strategy involves global retrieval followed by re-ranking using patch-level descriptors. Most deep learning-based methods in an end-to-end manner cannot extract global features with sufficient semantic information from RGB images. In contrast, re-ranking can utilize more explicit structural and semantic information in one-to-one matching process, but it is time-consuming. To bridge the gap between global retrieval and re-ranking and achieve a good trade-off between accuracy and efficiency, we propose StructVPR++, a framework that embeds structural and semantic knowledge into RGB global representations via segmentation-guided distillation. Our key innovation lies in decoupling label-specific features from global descriptors, enabling explicit semantic alignment between image pairs without requiring segmentation during deployment. Furthermore, we introduce a sample-wise weighted distillation strategy that prioritizes reliable training pairs while suppressing noisy ones. Experiments on four benchmarks demonstrate that StructVPR++ surpasses state-of-the-art global methods by 5-23% in Recall@1 and even outperforms many two-stage approaches, achieving real-time efficiency with a single RGB input.

📄 PDF Abstract BibTeX arXiv:2503.06601

Code (1)

syqlyx/StructVPR 공식 구현 pytorch

Tasks

Autonomous DrivingImage RetrievalRe-RankingRetrievalVisual Place Recognition

Similar Papers 제목 키워드 기반

StructVPR: Distill Structural Knowledge with Weighting Samples for Visual Place Recognition

2022-12-02 · CVPR 2023 1 · Yanqing Shen, Sanping Zhou, Jingwen Fu, Ruotong Wang 외

Visual place recognition (VPR) is usually considered as a specific image retrieval problem. Limited by existing training frameworks, most deep learning-based works cannot extract sufficiently stable global features from …

Image RetrievalKnowledge DistillationRe-RankingRetrieval+1

Adaptive Weighting in Knowledge Distillation: An Axiomatic Framework for Multi-Scale Teacher Ensemble Optimization

2026-01-25 · Aaron R. Flouro, Shawn P. Chadwick arxiv

Knowledge distillation with multiple teachers is increasingly used to improve robustness, efficiency, and safety, yet existing approaches rely largely on heuristic or implementation-specific weighting schemes. This paper…

Knowledge Distillation

DWA-KD: Dual-Space Weighting and Time-Warped Alignment for Cross-Tokenizer Knowledge Distillation

2026-02-25 · Duc Trung Vu, Pham Khanh Chi, Dat Phi Van, Linh Ngo Van 외 arxiv

Knowledge Distillation (KD) has emerged as a crucial technique for compressing Large Language Models (LLMs). Although existing cross-tokenizer KD methods have made notable progress, their effectiveness remains constraine…

Knowledge Distillation

Multi-Granularity Structural Knowledge Distillation for Language Model Compression

2022-05-01 · ACL 2022 5 · Chang Liu, Chongyang Tao, Jiazhan Feng, Dongyan Zhao

Transferring the knowledge to a small model through distillation has raised great interest in recent years. Prevailing methods transfer the knowledge derived from mono-granularity language units (e.g., token-level or sam…

Knowledge DistillationLanguage ModelingLanguage ModellingModel Compression+1

SRA: Span Representation Alignment for Large Language Model Distillation

2026-05-02 · Quoc Phong Dao, Hoang Son Nguyen, Pham Khanh Chi, Tung Nguyen 외 arxiv

Cross-Tokenizer Knowledge Distillation (CTKD) enables knowledge transfer between a large language model and a smaller student, even when they employ different tokenizers. While existing approaches mainly focus on token-l…

Knowledge Distillation