GAN-Knowledge Distillation for one-stage Object Detection
Convolutional neural networks have a significant improvement in the accuracy of Object detection. As convolutional neural networks become deeper, the accuracy of detection is also obviously improved, and more floating-point calculations are needed. Many researchers use the knowledge distillation method to improve the accuracy of student networks by transferring knowledge from a deeper and larger teachers network to a small student network, in object detection. Most methods of knowledge distillation need to designed complex cost functions and they are aimed at the two-stage object detection algorithm. This paper proposes a clean and effective knowledge distillation method for the one-stage object detection. The feature maps generated by teacher network and student network are used as true samples and fake samples respectively, and generate adversarial training for both to improve the performance of the student network in one-stage object detection.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationObjectobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Open-Vocabulary One-Stage Detection with Hierarchical Visual-Language Knowledge Distillation
Open-vocabulary object detection aims to detect novel object categories beyond the training set. The advanced open-vocabulary two-stage detectors employ instance-level visual-to-visual knowledge distillation to align the…
Knowledge DistillationLanguage ModellingObjectobject-detection+3Label Assignment Distillation for Object Detection
Knowledge distillation methods are proved to be promising in improving the performance of neural networks and no additional computational expenses are required during the inference time. For the sake of boosting the accu…
Knowledge DistillationObjectobject-detectionObject DetectionGradient-Guided Knowledge Distillation for Object Detectors
Deep learning models have demonstrated remarkable success in object detection, yet their complexity and computational intensity pose a barrier to deploying them in real-world applications (e.g., self-driving perception).…
Knowledge DistillationObjectobject-detectionObject DetectionAdaptive Instance Distillation for Object Detection in Autonomous Driving
In recent years, knowledge distillation (KD) has been widely used to derive efficient models. Through imitating a large teacher model, a lightweight student model can achieve comparable performance with more efficiency. …
Autonomous DrivingKnowledge Distillationobject-detectionObject DetectionImprove Object Detection with Feature-based Knowledge Distillation: Towards Accurate and Efficient Detectors
Knowledge distillation, in which a student model is trained to mimic a teacher model, has been proved as an effective technique for model compression and model accuracy boosting. However, most knowledge distillation meth…
image-classificationImage ClassificationKnowledge DistillationModel Compression+2