paper-with-me

Papers

Multi-Frame to Single-Frame: Knowledge Distillation for 3D Object Detection

2020-09-24 · Yue Wang, Alireza Fathi, Jiajun Wu, Thomas Funkhouser, Justin Solomon

A common dilemma in 3D object detection for autonomous driving is that high-quality, dense point clouds are only available during training, but not testing. We use knowledge distillation to bridge the gap between a model trained on high-quality inputs at training time and another tested on low-quality inputs at inference time. In particular, we design a two-stage training pipeline for point cloud object detection. First, we train an object detection model on dense point clouds, which are generated from multiple frames using extra information only available at training time. Then, we train the model's identical counterpart on sparse single-frame point clouds with consistency regularization on features from both models. We show that this procedure improves performance on low-quality data during testing, without additional overhead.

📄 PDF Abstract BibTeX arXiv:2009.11859

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionAutonomous DrivingKnowledge DistillationObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Boosting Single-Frame 3D Object Detection by Simulating Multi-Frame Point Clouds

2022-07-03 · Wu Zheng, Li Jiang, Fanbin Lu, Yangyang Ye 외

To boost a detector for single-frame 3D object detection, we present a new approach to train it to simulate features and responses following a detector trained on multi-frame point clouds. Our approach needs multi-frame …

3D Object DetectionObjectobject-detectionObject Detection+1

Multi-to-Single Knowledge Distillation for Point Cloud Semantic Segmentation

2023-04-28 · Shoumeng Qiu, Feng Jiang, Haiqiang Zhang, xiangyang xue 외

3D point cloud semantic segmentation is one of the fundamental tasks for environmental understanding. Although significant progress has been made in recent years, the performance of classes with few examples or few point…

Knowledge DistillationSemantic Segmentation

Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains

2020-12-02 · ACL 2021 5 · Haojie Pan, Chengyu Wang, Minghui Qiu, Yichang Zhang 외

Pre-trained language models have been applied to various NLP tasks with considerable performance gains. However, the large model sizes, together with the long inference time, limit the deployment of such models in real-t…

Knowledge DistillationLanguage ModelingLanguage ModellingMeta-Learning+2

AMTSS: An Adaptive Multi-Teacher Single-Student Knowledge Distillation Framework For Multilingual Language Inference

2023-05-13 · Qianglong Chen, Feng Ji, Feng-Lin Li, Guohai Xu 외

Knowledge distillation is of key importance to launching multilingual pre-trained language models for real applications. To support cost-effective language inference in multilingual settings, we propose AMTSS, an adaptiv…

Knowledge Distillation

Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentation

2025-05-30 · Roger Ferrod, Cássio F. Dantas, Luigi di Caro, Dino Ienco

Multi-modal RGB and Depth (RGBD) data are predominant in many domains such as robotics, autonomous driving and remote sensing. The combination of these multi-modal data enhances environmental perception by providing 3D s…

Autonomous DrivingContrastive LearningData AugmentationDisentanglement+3