BYOLMed3D: Self-Supervised Representation Learning of Medical Videos using Gradient Accumulation Assisted 3D BYOL Framework

2022-07-31 · Siladittya Manna, Rakesh Dey, Souvik Chakraborty

Applications on Medical Image Analysis suffer from acute shortage of large volume of data properly annotated by medical experts. Supervised Learning algorithms require a large volumes of balanced data to learn robust representations. Often supervised learning algorithms require various techniques to deal with imbalanced data. Self-supervised learning algorithms on the other hand are robust to imbalance in the data and are capable of learning robust representations. In this work, we train a 3D BYOL self-supervised model using gradient accumulation technique to deal with the large number of samples in a batch generally required in a self-supervised algorithm. To the best of our knowledge, this work is one of the first of its kind in this domain. We compare the results obtained through our experiments in the downstream task of ACL Tear Injury detection with the contemporary self-supervised pre-training methods and also with ResNet3D-18 initialized with the Kinetics-400 pre-trained weights. From the downstream task experiments, it is evident that the proposed framework outperforms the existing baselines.

📄 PDF Abstract BibTeX arXiv:2208.00444

Code (0)

등록된 구현이 없습니다.

Tasks

Medical Image AnalysisRepresentation Learning Self-Supervised Learning

Methods 이 논문이 사용한 방법론

BYOL 설명 없음

Self-supervised contrastive learning of echocardiogram videos enables label-efficient cardiac disease diagnosis

2022-07-23 · Gregory Holste, Evangelos K. Oikonomou, Bobak J. Mortazavi, Zhangyang Wang 외

Advances in self-supervised learning (SSL) have shown that self-supervised pretraining on medical imaging data can provide a strong initialization for downstream supervised classification and segmentation. Given the diff…

Classification Contrastive Learning Representation Learning Self-Supervised Learning+1

Contrastive Self-Supervised Learning for Spatio-Temporal Analysis of Lung Ultrasound Videos

2023-10-14 · Li Chen, Jonathan Rubin, Jiahong Ouyang, Naveen Balaraju 외

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art …

Contrastive Learning Self-Supervised Learning

SKID: Self-Supervised Learning for Knee Injury Diagnosis from MRI Data

2021-04-21 · Siladittya Manna, Saumik Bhattacharya, Umapada Pal

In medical image analysis, the cost of acquiring high-quality data and their annotation by experts is a barrier in many medical applications. Most of the techniques used are based on supervised learning framework and nee…

Medical Diagnosis Medical Image Analysis Medical Image Classification Multi-Label Classification+2

Time Does Tell: Self-Supervised Time-Tuning of Dense Image Representations

2023-08-22 · ICCV 2023 1 · Mohammadreza Salehi, Efstratios Gavves, Cees G. M. Snoek, Yuki M. Asano

Spatially dense self-supervised learning is a rapidly growing problem domain with promising applications for unsupervised segmentation and pretraining for dense downstream tasks. Despite the abundance of temporal data in…

Self-Supervised Learning Semantic Segmentation Unsupervised Semantic Segmentation

M3Ret: Unleashing Zero-shot Multimodal Medical Image Retrieval via Self-Supervision

2025-09-01 · Che Liu, Zheng Jiang, Chengyu Fang, Heng Guo 외 arxiv

Medical image retrieval is essential for clinical decision-making and translational research, relying on discriminative visual representations. Yet, current methods remain fragmented, relying on separate architectures an…

Self-Supervised Learning Medical Image Retrieval