Low-Resolution Object Recognition with Cross-Resolution Relational Contrastive Distillation
Recognizing objects in low-resolution images is a challenging task due to the lack of informative details. Recent studies have shown that knowledge distillation approaches can effectively transfer knowledge from a high-resolution teacher model to a low-resolution student model by aligning cross-resolution representations. However, these approaches still face limitations in adapting to the situation where the recognized objects exhibit significant representation discrepancies between training and testing images. In this study, we propose a cross-resolution relational contrastive distillation approach to facilitate low-resolution object recognition. Our approach enables the student model to mimic the behavior of a well-trained teacher model which delivers high accuracy in identifying high-resolution objects. To extract sufficient knowledge, the student learning is supervised with contrastive relational distillation loss, which preserves the similarities in various relational structures in contrastive representation space. In this manner, the capability of recovering missing details of familiar low-resolution objects can be effectively enhanced, leading to a better knowledge transfer. Extensive experiments on low-resolution object classification and low-resolution face recognition clearly demonstrate the effectiveness and adaptability of our approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Face RecognitionKnowledge DistillationObject RecognitionTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image Recognition
In spite of great success in many image recognition tasks achieved by recent deep models, directly applying them to recognize low-resolution images may suffer from low accuracy due to the missing of informative details d…
Face Recognitionimage-classificationImage ClassificationKnowledge Distillation+2Distilling Generative-Discriminative Representations for Very Low-Resolution Face Recognition
Very low-resolution face recognition is challenging due to the serious loss of informative facial details in resolution degradation. In this paper, we propose a generative-discriminative representation distillation appro…
Face RecognitionKnowledge DistillationSuper-ResolutionTransfer LearningImproving Performance of Object Detection using the Mechanisms of Visual Recognition in Humans
Object recognition systems are usually trained and evaluated on high resolution images. However, in real world applications, it is common that the images have low resolutions or have small sizes. In this study, we first …
Objectobject-detectionObject DetectionObject RecognitionGeneric Statistical Relational Entity Resolution in Knowledge Graphs
Entity resolution, the problem of identifying the underlying entity of references found in data, has been researched for many decades in many communities. A common theme in this research has been the importance of incorp…
Entity ResolutionKnowledge GraphsExploiting Temporal Relations on Radar Perception for Autonomous Driving
We consider the object recognition problem in autonomous driving using automotive radar sensors. Comparing to Lidar sensors, radar is cost-effective and robust in all-weather conditions for perception in autonomous drivi…
2D Object DetectionAutonomous DrivingMultiple Object TrackingObject+4