Self-supervised Representation Learning for Ultrasound Video
Recent advances in deep learning have achieved promising performance for medical image analysis, while in most cases ground-truth annotations from human experts are necessary to train the deep model. In practice, such annotations are expensive to collect and can be scarce for medical imaging applications. Therefore, there is significant interest in learning representations from unlabelled raw data. In this paper, we propose a self-supervised learning approach to learn meaningful and transferable representations from medical imaging video without any type of human annotation. We assume that in order to learn such a representation, the model should identify anatomical structures from the unlabelled data. Therefore we force the model to address anatomy-aware tasks with free supervision from the data itself. Specifically, the model is designed to correct the order of a reshuffled video clip and at the same time predict the geometric transformation applied to the video clip. Experiments on fetal ultrasound video show that the proposed approach can effectively learn meaningful and strong representations, which transfer well to downstream tasks like standard plane detection and saliency prediction.
Code (0)
등록된 구현이 없습니다.
Tasks
AnatomyMedical Image AnalysisRepresentation LearningSaliency PredictionSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Self-supervised Contrastive Video-Speech Representation Learning for Ultrasound
In medical imaging, manual annotations can be expensive to acquire and sometimes infeasible to access, making conventional deep learning-based models difficult to scale. As a result, it would be beneficial if useful repr…
Contrastive LearningGaze PredictionRepresentation LearningSpeech Representation LearningContrastive Self-Supervised Learning for Spatio-Temporal Analysis of Lung Ultrasound Videos
Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art …
Contrastive LearningSelf-Supervised LearningSelf-supervised Learning of Echocardiographic Video Representations via Online Cluster Distillation
Self-supervised learning (SSL) has achieved major advances in natural images and video understanding, but challenges remain in domains like echocardiography (heart ultrasound) due to subtle anatomical structures, complex…
Anomaly DetectionClusteringRepresentation LearningSelf-Supervised Learning+2Towards Objective Obstetric Ultrasound Assessment: Contrastive Representation Learning for Fetal Movement Detection
Accurate fetal movement (FM) detection is essential for assessing prenatal health, as abnormal movement patterns can indicate underlying complications such as placental dysfunction or fetal distress. Traditional methods,…
Self-Supervised LearningRepresentation LearningContrastive LearningIntra-video Positive Pairs in Self-Supervised Learning for Ultrasound
Self-supervised learning (SSL) is one strategy for addressing the paucity of labelled data in medical imaging by learning representations from unlabelled images. Contrastive and non-contrastive SSL methods produce learne…
Contrastive LearningSelf-Supervised Learning