Self-Supervised Learning Featuring Small-Scale Image Dataset for Treatable Retinal Diseases Classification
Automated medical diagnosis through image-based neural networks has increased in popularity and matured over years. Nevertheless, it is confined by the scarcity of medical images and the expensive labor annotation costs. Self-Supervised Learning (SSL) is an good alternative to Transfer Learning (TL) and is suitable for imbalanced image datasets. In this study, we assess four pretrained SSL models and two TL models in treatable retinal diseases classification using small-scale Optical Coherence Tomography (OCT) images ranging from 125 to 4000 with balanced or imbalanced distribution for training. The proposed SSL model achieves the state-of-art accuracy of 98.84% using only 4,000 training images. Our results suggest the SSL models provide superior performance under both the balanced and imbalanced training scenarios. The SSL model with MoCo-v2 scheme has consistent good performance under the imbalanced scenario and, especially, surpasses the other models when the training set is less than 500 images.
Code (0)
등록된 구현이 없습니다.
Tasks
Medical DiagnosisSelf-Supervised LearningTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SOLAR: Self-supervised Joint Learning for Symmetric Multimodal Retrieval
In this work, we address the critical yet underexplored challenge of symmetric multimodal-to-multimodal (MM2MM) retrieval, where queries and contexts are interchangeable. Existing universal multimodal retrieval works str…
Exploring Self-Supervised Representation Learning For Low-Resource Medical Image Analysis
The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from n…
Medical Image AnalysisPrognosisRepresentation LearningSelf-Supervised Learning+1Rethinking Self-Supervised Learning: Small is Beautiful
Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep le…
Contrastive LearningSelf-Supervised LearningSolo-learn: A Library of Self-supervised Methods for Visual Representation Learning
This paper presents solo-learn, a library of self-supervised methods for visual representation learning. Implemented in Python, using Pytorch and Pytorch lightning, the library fits both research and industry needs by fe…
Linear evaluationRepresentation LearningSelf-Supervised LearningAre Large-scale Datasets Necessary for Self-Supervised Pre-training?
Pre-training models on large scale datasets, like ImageNet, is a standard practice in computer vision. This paradigm is especially effective for tasks with small training sets, for which high-capacity models tend to over…
DenoisingInstance SegmentationSemantic Segmentation