paper-with-me

Papers

Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation

2025-03-17 · Nassim Ali Ousalah, Anis Kacem, Enjie Ghorbel, Emmanuel Koumandakis, Djamila Aouada

Compact and efficient 6DoF object pose estimation is crucial in applications such as robotics, augmented reality, and space autonomous navigation systems, where lightweight models are critical for real-time accurate performance. This paper introduces a novel uncertainty-aware end-to-end Knowledge Distillation (KD) framework focused on keypoint-based 6DoF pose estimation. Keypoints predicted by a large teacher model exhibit varying levels of uncertainty that can be exploited within the distillation process to enhance the accuracy of the student model while ensuring its compactness. To this end, we propose a distillation strategy that aligns the student and teacher predictions by adjusting the knowledge transfer based on the uncertainty associated with each teacher keypoint prediction. Additionally, the proposed KD leverages this uncertainty-aware alignment of keypoints to transfer the knowledge at key locations of their respective feature maps. Experiments on the widely-used LINEMOD benchmark demonstrate the effectiveness of our method, achieving superior 6DoF object pose estimation with lightweight models compared to state-of-the-art approaches. Further validation on the SPEED+ dataset for spacecraft pose estimation highlights the robustness of our approach under diverse 6DoF pose estimation scenarios.

📄 PDF Abstract BibTeX arXiv:2503.13053

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous NavigationKnowledge DistillationPose EstimationSpacecraft Pose EstimationTransfer Learning

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Uncertainty-Aware Dual-Student Knowledge Distillation for Efficient Image Classification

2025-11-24 · Aakash Gore, Anoushka Dey, Aryan Mishra arxiv

Knowledge distillation has emerged as a powerful technique for model compression, enabling the transfer of knowledge from large teacher networks to compact student models. However, traditional knowledge distillation meth…

Knowledge DistillationImage ClassificationModel Compression

Computation-Efficient Knowledge Distillation via Uncertainty-Aware Mixup

2020-12-17 · Guodong Xu, Ziwei Liu, Chen Change Loy

Knowledge distillation, which involves extracting the "dark knowledge" from a teacher network to guide the learning of a student network, has emerged as an essential technique for model compression and transfer learning.…

InformativenessKnowledge DistillationModel CompressionTransfer Learning

U-Know-DiffPAN: An Uncertainty-aware Knowledge Distillation Diffusion Framework with Details Enhancement for PAN-Sharpening

2024-12-09 · CVPR 2025 1 · Sungpyo Kim, Jeonghyeok Do, Jaehyup Lee, Munchurl Kim

Conventional methods for PAN-sharpening often struggle to restore fine details due to limitations in leveraging high-frequency information. Moreover, diffusion-based approaches lack sufficient conditioning to fully utili…

Knowledge Distillation

Uncertainty-Aware Multi-Expert Knowledge Distillation for Imbalanced Disease Grading

2025-05-01 · Shuo Tong, Shangde Gao, Ke Liu, Zihang Huang 외

Automatic disease image grading is a significant application of artificial intelligence for healthcare, enabling faster and more accurate patient assessments. However, domain shifts, which are exacerbated by data imbalan…

Knowledge DistillationTransfer Learning

Uncertainty-Aware Knowledge Distillation for Multimodal Large Language Models

2026-03-22 · Jingchen Sun, Shaobo Han, Deep Patel, Wataru Kohno 외 arxiv

Knowledge distillation establishes a learning paradigm that leverages both data supervision and teacher guidance. However, determining the optimal balance between learning from data and learning from the teacher is chall…

Knowledge Distillation