Unlabeled Data Deployment for Classification of Diabetic Retinopathy Images Using Knowledge Transfer
Convolutional neural networks (CNNs) are extensively beneficial for medical image processing. Medical images are plentiful, but there is a lack of annotated data. Transfer learning is used to solve the problem of lack of labeled data and grants CNNs better training capability. Transfer learning can be used in many different medical applications; however, the model under transfer should have the same size as the original network. Knowledge distillation is recently proposed to transfer the knowledge of a model to another one and can be useful to cover the shortcomings of transfer learning. But some parts of the knowledge may not be distilled by knowledge distillation. In this paper, a novel knowledge distillation using transfer learning is proposed to transfer the whole knowledge of a model to another one. The proposed method can be beneficial and practical for medical image analysis in which a small number of labeled data are available. The proposed process is tested for diabetic retinopathy classification. Simulation results demonstrate that using the proposed method, knowledge of an extensive network can be transferred to a smaller model.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationKnowledge DistillationMedical Image AnalysisTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Semi-Supervised and Self-Supervised Learning for Diabetic Retinopathy Detection
Diabetic retinopathy (DR) is one of the leading causes of blindness in the working-age population of developed countries, caused by a side effect of diabetes that reduces the blood supply to the retina. Deep neural netwo…
Diabetic Retinopathy DetectionKnowledge DistillationSelf-Supervised LearningAutomated Smartphone based System for Diagnosis of Diabetic Retinopathy
Early diagnosis of diabetic retinopathy for treatment of the disease has been failing to reach diabetic people living in rural areas. Shortage of trained ophthalmologists, limited availability of healthcare centers, and …
DiagnosticAutomated Diabetic Retinopathy Grading using Deep Convolutional Neural Network
Diabetic Retinopathy is a global health problem, influences 100 million individuals worldwide, and in the next few decades, these incidences are expected to reach epidemic proportions. Diabetic Retinopathy is a subtle ey…
Diabetic Retinopathy GradingGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONDiabetic Retinopathy Classification using Downscaling Algorithms and Deep Learning
Diabetic Retinopathy (DR) is an art and science of recording and classifying the retinal images of a diabetic patient. DR classification deals with classifying retinal fundus image into five stages on the basis of severi…
Transfer-Ensemble Learning based Deep Convolutional Neural Networks for Diabetic Retinopathy Classification
This article aims to classify diabetic retinopathy (DR) disease into five different classes using an ensemble approach based on two popular pre-trained convolutional neural networks: VGG16 and Inception V3. The proposed …
Ensemble Learning