paper-with-me

홈 › Papers

A Survey of the Impact of Self-Supervised Pretraining for Diagnostic Tasks with Radiological Images

2023-09-05 · Blake VanBerlo, Jesse Hoey, Alexander Wong

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed tomography, magnetic resonance, and ultrasound imaging, concentrating on studies that compare self-supervised pretraining to fully supervised learning for diagnostic tasks such as classification and segmentation. The most pertinent finding is that self-supervised pretraining generally improves downstream task performance compared to full supervision, most prominently when unlabelled examples greatly outnumber labelled examples. Based on the aggregate evidence, recommendations are provided for practitioners considering using self-supervised learning. Motivated by limitations identified in current research, directions and practices for future study are suggested, such as integrating clinical knowledge with theoretically justified self-supervised learning methods, evaluating on public datasets, growing the modest body of evidence for ultrasound, and characterizing the impact of self-supervised pretraining on generalization.

📄 PDF Abstract BibTeX arXiv:2309.02555

Code (0)

등록된 구현이 없습니다.

Tasks

Clinical KnowledgeDiagnosticSelf-Supervised LearningTransfer Learning

Similar Papers 제목 키워드 기반

Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare

2024-05-10 · Xingyu Li, Lu Peng, Yuping Wang, Weihua Zhang

This survey explores the transformative impact of foundation models (FMs) in artificial intelligence, focusing on their integration with federated learning (FL) for advancing biomedical research. Foundation models such a…

DiagnosticFederated LearningSelf-Supervised LearningSurvey

Self-supervised Pretraining for Decision Foundation Model: Formulation, Pipeline and Challenges

2023-12-29 · Xiaoqian Liu, Jianbin Jiao, Junge Zhang

Decision-making is a dynamic process requiring perception, memory, and reasoning to make choices and find optimal policies. Traditional approaches to decision-making suffer from sample efficiency and generalization, whil…

Decision MakingFew-Shot Learning

ViT-2SPN: Vision Transformer-based Dual-Stream Self-Supervised Pretraining Networks for Retinal OCT Classification

2025-01-28 · Mohammadreza Saraei, Igor Kozak, Eung-Joo Lee

Optical Coherence Tomography (OCT) is a non-invasive imaging modality essential for diagnosing various eye diseases. Despite its clinical significance, developing OCT-based diagnostic tools faces challenges, such as limi…

Data AugmentationDiagnosticMedical Image ClassificationRetinal OCT Disease Classification+1

AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing

2021-08-12 · Katikapalli Subramanyam Kalyan, Ajit Rajasekharan, Sivanesan Sangeetha

Transformer-based pretrained language models (T-PTLMs) have achieved great success in almost every NLP task. The evolution of these models started with GPT and BERT. These models are built on the top of transformers, sel…

Self-Supervised LearningSurveyTransfer Learning

Interaction of a priori Anatomic Knowledge with Self-Supervised Contrastive Learning in Cardiac Magnetic Resonance Imaging

2022-05-25 · Makiya Nakashima, Inyeop Jang, Ramesh Basnet, Mitchel Benovoy 외

Training deep learning models on cardiac magnetic resonance imaging (CMR) can be a challenge due to the small amount of expert generated labels and inherent complexity of data source. Self-supervised contrastive learning…

AnatomyContrastive LearningDiagnostic