paper-with-me

홈 › Papers

TeTRA-VPR: A Ternary Transformer Approach for Compact Visual Place Recognition

2025-03-04 · Oliver Grainge, Michael Milford, Indu Bodala, Sarvapali D. Ramchurn, Shoaib Ehsan

Visual Place Recognition (VPR) localizes a query image by matching it against a database of geo-tagged reference images, making it essential for navigation and mapping in robotics. Although Vision Transformer (ViT) solutions deliver high accuracy, their large models often exceed the memory and compute budgets of resource-constrained platforms such as drones and mobile robots. To address this issue, we propose TeTRA, a ternary transformer approach that progressively quantizes the ViT backbone to 2-bit precision and binarizes its final embedding layer, offering substantial reductions in model size and latency. A carefully designed progressive distillation strategy preserves the representational power of a full-precision teacher, allowing TeTRA to retain or even surpass the accuracy of uncompressed convolutional counterparts, despite using fewer resources. Experiments on standard VPR benchmarks demonstrate that TeTRA reduces memory consumption by up to 69% compared to efficient baselines, while lowering inference latency by 35%, with either no loss or a slight improvement in recall@1. These gains enable high-accuracy VPR on power-constrained, memory-limited robotic platforms, making TeTRA an appealing solution for real-world deployment.

📄 PDF Abstract BibTeX arXiv:2503.02511

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Place Recognition

Methods 이 논문이 사용한 방법론

Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

TAT-VPR: Ternary Adaptive Transformer for Dynamic and Efficient Visual Place Recognition

2025-05-22 · Oliver Grainge, Michael Milford, Indu Bodala, Sarvapali D. Ramchurn 외

TAT-VPR is a ternary-quantized transformer that brings dynamic accuracy-efficiency trade-offs to visual SLAM loop-closure. By fusing ternary weights with a learned activation-sparsity gate, the model can control computat…

Visual Place Recognition

FTerViT: Fully Ternary Vision Transformer

2026-05-20 · Szymon Ruciński, Pietro Bonazzi, Engin Türetken, Simon Narduzzi 외 arxiv

Ternary Vision Transformers offer substantial model compression, however state-of-the-art methods only ternarize the encoder layers, leaving patch embeddings, LayerNorm parameters, and classifier heads in full precision.…

Knowledge DistillationModel Compression

LiteTrack: Layer Pruning with Asynchronous Feature Extraction for Lightweight and Efficient Visual Tracking

2023-09-17 · Qingmao Wei, Bi Zeng, Jianqi Liu, Li He 외

The recent advancements in transformer-based visual trackers have led to significant progress, attributed to their strong modeling capabilities. However, as performance improves, running latency correspondingly increases…

GPUVisual Tracking

TerViT: An Efficient Ternary Vision Transformer

2022-01-20 · Sheng Xu, Yanjing Li, Teli Ma, Bohan Zeng 외

Vision transformers (ViTs) have demonstrated great potential in various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-constrained devices. In this paper, we intr…

TetraTSDF: 3D human reconstruction from a single image with a tetrahedral outer shell

2020-04-22 · CVPR 2020 6 · Hayato Onizuka, Zehra Hayirci, Diego Thomas, Akihiro Sugimoto 외

Recovering the 3D shape of a person from its 2D appearance is ill-posed due to ambiguities. Nevertheless, with the help of convolutional neural networks (CNN) and prior knowledge on the 3D human body, it is possible to o…

3D Human Reconstructionregression