paper-with-me

Papers

Exploring Self-Supervised Representation Learning For Low-Resource Medical Image Analysis

2023-03-03 · Soumitri Chattopadhyay, Soham Ganguly, Sreejit Chaudhury, Sayan Nag, Samiran Chattopadhyay

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the assumption of data availability is unrealistic and impractical, as the data itself is scanty and found in small databases, collected for specific prognosis tasks. To this end, we seek to investigate the applicability of self-supervised learning algorithms on small-scale medical imaging datasets. In particular, we evaluate $4$ state-of-the-art SSL methods on three publicly accessible \emph{small} medical imaging datasets. Our investigation reveals that in-domain low-resource SSL pre-training can yield competitive performance to transfer learning from large-scale datasets (such as ImageNet). Furthermore, we extensively analyse our empirical findings to provide valuable insights that can motivate for further research towards circumventing the need for pre-training on a large image corpus. To the best of our knowledge, this is the first attempt to holistically explore self-supervision on low-resource medical datasets.

📄 PDF Abstract BibTeX arXiv:2303.02245

Code (1)

soumitri2001/smalldatassl 공식 구현 pytorch

Tasks

Medical Image AnalysisPrognosisRepresentation LearningSelf-Supervised LearningTransfer Learning

Similar Papers 제목 키워드 기반

Exploring Representation Learning for Small-Footprint Keyword Spotting

2023-03-20 · Fan Cui, Liyong Guo, Quandong Wang, Peng Gao 외

In this paper, we investigate representation learning for low-resource keyword spotting (KWS). The main challenges of KWS are limited labeled data and limited available device resources. To address those challenges, we e…

Contrastive LearningKeyword SpottingRepresentation LearningSmall-Footprint Keyword Spotting

Exploring Intrinsic Properties of Medical Images for Self-Supervised Binary Semantic Segmentation

2024-02-04 · Pranav Singh, Jacopo Cirrone

Recent advancements in self-supervised learning have unlocked the potential to harness unlabeled data for auxiliary tasks, facilitating the learning of beneficial priors. This has been particularly advantageous in fields…

DecoderImage SegmentationMedical Image AnalysisMedical Image Segmentation+3

A Lightweight Medical Image Classification Framework via Self-Supervised Contrastive Learning and Quantum-Enhanced Feature Modeling

2026-01-23 · Jingsong Xia, Siqi Wang arxiv

Intelligent medical image analysis is essential for clinical decision support but is often limited by scarce annotations, constrained computational resources, and suboptimal model generalization. To address these challen…

Medical Image ClassificationSelf-Supervised LearningContrastive Learning

Exploring Low-Resource Medical Image Classification with Weakly Supervised Prompt Learning

2024-02-06 · Fudan Zheng, Jindong Cao, Weijiang Yu, Zhiguang Chen 외

Most advances in medical image recognition supporting clinical auxiliary diagnosis meet challenges due to the low-resource situation in the medical field, where annotations are highly expensive and professional. This low…

Few-Shot Learningimage-classificationImage ClassificationLanguage Modeling+4

Aggregative Self-Supervised Feature Learning from a Limited Sample

2020-12-14 · Jiuwen Zhu, Yuexiang Li, S. Kevin Zhou

Self-supervised learning (SSL) is an efficient approach that addresses the issue of limited training data and annotation shortage. The key part in SSL is its proxy task that defines the supervisory signals and drives the…

image-classificationImage ClassificationMedical Image ClassificationSelf-Supervised Learning