Learning Representations with Contrastive Self-Supervised Learning for Histopathology Applications
Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent methods are approaching the performance achieved by fully supervised training. The ImageNet dataset is however largely object-centric, and it is not clear yet what potential those methods have on widely different datasets and tasks that are not object-centric, such as in digital pathology. While self-supervised learning has started to be explored within this area with encouraging results, there is reason to look closer at how this setting differs from natural images and ImageNet. In this paper we make an in-depth analysis of contrastive learning for histopathology, pin-pointing how the contrastive objective will behave differently due to the characteristics of histopathology data. We bring forward a number of considerations, such as view generation for the contrastive objective and hyper-parameter tuning. In a large battery of experiments, we analyze how the downstream performance in tissue classification will be affected by these considerations. The results point to how contrastive learning can reduce the annotation effort within digital pathology, but that the specific dataset characteristics need to be considered. To take full advantage of the contrastive learning objective, different calibrations of view generation and hyper-parameters are required. Our results pave the way for realizing the full potential of self-supervised learning for histopathology applications.
Code (1)
Tasks
BenchmarkingContrastive LearningSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Hierarchical Text-to-Vision Self Supervised Alignment for Improved Histopathology Representation Learning
Self-supervised representation learning has been highly promising for histopathology image analysis with numerous approaches leveraging their patient-slide-patch hierarchy to learn better representations. In this paper, …
Representation LearningSelf-Supervised LearningEfficient Self-Supervision using Patch-based Contrastive Learning for Histopathology Image Segmentation
Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures…
Contrastive LearningImage SegmentationSelf-Supervised LearningSemantic SegmentationLesion-Aware Contrastive Representation Learning for Histopathology Whole Slide Images Analysis
Local representation learning has been a key challenge to promote the performance of the histopathological whole slide images analysis. The previous representation learning methods followed the supervised learning paradi…
Contrastive LearningRepresentation Learningwhole slide imagesMagnification Prior: A Self-Supervised Method for Learning Representations on Breast Cancer Histopathological Images
This work presents a novel self-supervised pre-training method to learn efficient representations without labels on histopathology medical images utilizing magnification factors. Other state-of-theart works mainly focus …
Breast Cancer Histology Image ClassificationBreast Cancer Histology Image Classification (20% labels)Classification Of Breast Cancer Histology ImagesRepresentation Learning+1Self supervised contrastive learning for digital histopathology
Unsupervised learning has been a long-standing goal of machine learning and is especially important for medical image analysis, where the learning can compensate for the scarcity of labeled datasets. A promising subclass…
Contrastive LearningMedical Image AnalysisSelf-Supervised Learning