paper-with-me

홈 › Papers

Lightweight 3D Object Detection via Mamba-Based Knowledge Distillation

2026-08-04 · Quoc Cuong Ninh, Huy Xuan Pham, Anh Tung Nguyen, Dinh Hoan Trinh arxiv

3D object detection using light detection and ranging (LiDAR) sensors requires a balance between accuracy and computational efficiency for onboard perception in autonomous driving and robotic navigation. Many existing LiDAR-based detection methods employ complex architectures to extract features, integrating large amounts of contextual information to enhance accuracy. This often results in significant computational costs, leading to suboptimal performance on resource-constrained embedded devices. In this study, we propose a knowledge distillation framework that transfers object-level voxel representations from a strong teacher model to lightweight student models through selective voxel-space feature alignment. Taking advantage of the linear-time sequence model with selective state spaces (Mamba), we design a multi-branch Mamba teacher backbone and a box-aware feature transfer mechanism that aligns spatially corresponding voxel features between teacher and student networks through a Mamba-based projection module. Experimental results on both a public dataset and real-world data show that our approach significantly reduces computational load while maintaining competitive accuracy compared with state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2608.03490

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyKnowledge Distillation3D Object DetectionAutonomous Driving

Similar Papers 제목 키워드 기반

Vision Mamba Distillation for Low-resolution Fine-grained Image Classification

2024-11-27 · Yao Chen, Jiabao Wang, Peichao Wang, Rui Zhang 외

Low-resolution fine-grained image classification has recently made significant progress, largely thanks to the super-resolution techniques and knowledge distillation methods. However, these approaches lead to an exponent…

ClassificationFine-Grained Image Classificationimage-classificationImage Classification+3

A Diffusion Model and Knowledge Distillation Framework for Robust Coral Detection in Complex Underwater Environments

2025-01-06 · SSRN 2025 1 · Zhaoxuan Lu; Lyuchao Liao; Chuang Li;Xingang Xie; Hui Yuan;

Coral reefs play a crucial role in marine ecosystems, but their sustainability is increasingly threatened by climate change and human activities. To aid in the protection and monitoring of these ecosystems, developing ad…

2D Object DetectionKnowledge DistillationMambaTransfer Learning

Unleashing the Potential of Mamba: Boosting a LiDAR 3D Sparse Detector by Using Cross-Model Knowledge Distillation

2024-09-17 · Rui Yu, Runkai Zhao, Jiagen Li, Qingsong Zhao 외

The LiDAR-based 3D object detector that strikes a balance between accuracy and speed is crucial for achieving real-time perception in autonomous driving and robotic navigation systems. To enhance the accuracy of point cl…

3D Object DetectionAutonomous DrivingCloud DetectionKnowledge Distillation+4

Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillation

2023-08-17 · Shengcao Cao, Mengtian Li, James Hays, Deva Ramanan 외

Resource-constrained perception systems such as edge computing and vision-for-robotics require vision models to be both accurate and lightweight in computation and memory usage. While knowledge distillation is a proven s…

Edge-computingInstance SegmentationKnowledge DistillationObject+3

DVMSR: Distillated Vision Mamba for Efficient Super-Resolution

2024-05-05 · Xiaoyan Lei, Wenlong Zhang, Weifeng Cao

Efficient Image Super-Resolution (SR) aims to accelerate SR network inference by minimizing computational complexity and network parameters while preserving performance. Existing state-of-the-art Efficient Image Super-Re…

Image Super-ResolutionLong-range modelingMambaSSIM+1