paper-with-me

홈 › Papers

Empowering Knowledge Distillation via Open Set Recognition for Robust 3D Point Cloud Classification

2020-10-25 · Ayush Bhardwaj, Sakshee Pimpale, Saurabh Kumar, Biplab Banerjee

Real-world scenarios pose several challenges to deep learning based computer vision techniques despite their tremendous success in research. Deeper models provide better performance, but are challenging to deploy and knowledge distillation allows us to train smaller models with minimal loss in performance. The model also has to deal with open set samples from classes outside the ones it was trained on and should be able to identify them as unknown samples while classifying the known ones correctly. Finally, most existing image recognition research focuses only on using two-dimensional snapshots of the real world three-dimensional objects. In this work, we aim to bridge these three research fields, which have been developed independently until now, despite being deeply interrelated. We propose a joint Knowledge Distillation and Open Set recognition training methodology for three-dimensional object recognition. We demonstrate the effectiveness of the proposed method via various experiments on how it allows us to obtain a much smaller model, which takes a minimal hit in performance while being capable of open set recognition for 3D point cloud data.

📄 PDF Abstract BibTeX arXiv:2010.13114

Code (0)

등록된 구현이 없습니다.

Tasks

3D Point Cloud ClassificationGeneral ClassificationKnowledge DistillationObject RecognitionOpen Set LearningPoint Cloud Classification

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Active Open-Vocabulary Recognition: Let Intelligent Moving Mitigate CLIP Limitations

2023-11-28 · CVPR 2024 1 · Lei Fan, Jianxiong Zhou, Xiaoying Xing, Ying Wu

Active recognition, which allows intelligent agents to explore observations for better recognition performance, serves as a prerequisite for various embodied AI tasks, such as grasping, navigation and room arrangements. …

Navigate

Knowledge Distillation via Route Constrained Optimization

2019-04-19 · ICCV 2019 10 · Xiao Jin, Baoyun Peng, Yi-Chao Wu, Yu Liu 외

Distillation-based learning boosts the performance of the miniaturized neural network based on the hypothesis that the representation of a teacher model can be used as structured and relatively weak supervision, and thus…

Face RecognitionKnowledge Distillation

Revealing the Two Sides of Data Augmentation: An Asymmetric Distillation-based Win-Win Solution for Open-Set Recognition

2024-04-28 · Yunbing Jia, Xiaoyu Kong, Fan Tang, Yixing Gao 외

In this paper, we reveal the two sides of data augmentation: enhancements in closed-set recognition correlate with a significant decrease in open-set recognition. Through empirical investigation, we find that multi-sampl…

Data AugmentationKnowledge DistillationOpen Set Learning

Personalised Distillation: Empowering Open-Sourced LLMs with Adaptive Learning for Code Generation

2023-10-28 · Hailin Chen, Amrita Saha, Steven Hoi, Shafiq Joty

With the rise of powerful closed-sourced LLMs (ChatGPT, GPT-4), there are increasing interests in distilling the capabilies of close-sourced LLMs to smaller open-sourced LLMs. Previous distillation methods usually prompt…

Code GenerationHumanEval

Topology-Guided Knowledge Distillation for Efficient Point Cloud Processing

2025-05-12 · Luu Tung Hai, Thinh D. Le, Zhicheng Ding, Qing Tian 외

Point cloud processing has gained significant attention due to its critical role in applications such as autonomous driving and 3D object recognition. However, deploying high-performance models like Point Transformer V3 …

3D Object RecognitionAutonomous DrivingKnowledge DistillationObject Recognition