paper-with-me

Papers

StructVPR: Distill Structural Knowledge with Weighting Samples for Visual Place Recognition

2022-12-02 · CVPR 2023 1 · Yanqing Shen, Sanping Zhou, Jingwen Fu, Ruotong Wang, Shitao Chen, Nanning Zheng

Visual place recognition (VPR) is usually considered as a specific image retrieval problem. Limited by existing training frameworks, most deep learning-based works cannot extract sufficiently stable global features from RGB images and rely on a time-consuming re-ranking step to exploit spatial structural information for better performance. In this paper, we propose StructVPR, a novel training architecture for VPR, to enhance structural knowledge in RGB global features and thus improve feature stability in a constantly changing environment. Specifically, StructVPR uses segmentation images as a more definitive source of structural knowledge input into a CNN network and applies knowledge distillation to avoid online segmentation and inference of seg-branch in testing. Considering that not all samples contain high-quality and helpful knowledge, and some even hurt the performance of distillation, we partition samples and weigh each sample's distillation loss to enhance the expected knowledge precisely. Finally, StructVPR achieves impressive performance on several benchmarks using only global retrieval and even outperforms many two-stage approaches by a large margin. After adding additional re-ranking, ours achieves state-of-the-art performance while maintaining a low computational cost.

📄 PDF Abstract BibTeX arXiv:2212.00937

Code (0)

등록된 구현이 없습니다.

Tasks

Image RetrievalKnowledge DistillationRe-RankingRetrievalVisual Place Recognition

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

StructVPR++: Distill Structural and Semantic Knowledge with Weighting Samples for Visual Place Recognition

2025-03-09 · Yanqing Shen, Sanping Zhou, Jingwen Fu, Ruotong Wang 외

Visual place recognition is a challenging task for autonomous driving and robotics, which is usually considered as an image retrieval problem. A commonly used two-stage strategy involves global retrieval followed by re-r…

Autonomous DrivingImage RetrievalRe-RankingRetrieval+1

Adaptive Weighting in Knowledge Distillation: An Axiomatic Framework for Multi-Scale Teacher Ensemble Optimization

2026-01-25 · Aaron R. Flouro, Shawn P. Chadwick arxiv

Knowledge distillation with multiple teachers is increasingly used to improve robustness, efficiency, and safety, yet existing approaches rely largely on heuristic or implementation-specific weighting schemes. This paper…

Knowledge Distillation

Prime-Aware Adaptive Distillation

2020-08-04 · ECCV 2020 8 · Youcai Zhang, Zhonghao Lan, Yuchen Dai, Fangao Zeng 외

Knowledge distillation(KD) aims to improve the performance of a student network by mimicing the knowledge from a powerful teacher network. Existing methods focus on studying what knowledge should be transferred and treat…

Knowledge DistillationMetric Learningobject-detectionObject Detection

Multi-Granularity Structural Knowledge Distillation for Language Model Compression

2022-05-01 · ACL 2022 5 · Chang Liu, Chongyang Tao, Jiazhan Feng, Dongyan Zhao

Transferring the knowledge to a small model through distillation has raised great interest in recent years. Prevailing methods transfer the knowledge derived from mono-granularity language units (e.g., token-level or sam…

Knowledge DistillationLanguage ModelingLanguage ModellingModel Compression+1

FedeKD: Energy-Based Gating for Robust Federated Knowledge Distillation under Heterogeneous Settings

2026-05-07 · Quang-Huy Nguyen, Jiaqi Wang, Wei-shinn Ku arxiv

Federated learning (FL) operates in heterogeneous environments, where variations in data distributions and asymmetric model design often result in negative transfer. While federated knowledge distillation (FKD) avoids di…

Knowledge DistillationFederated Learning