paper-with-me

홈 › Papers

Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation

2020-12-18 · José Morano, Álvaro S. Hervella, Noelia Barreira, Jorge Novo, José Rouco

In ophthalmology, the study of the retinal microcirculation is a key issue in the analysis of many ocular and systemic diseases, like hypertension or diabetes. This motivates the research on improving the retinal vasculature segmentation. Nowadays, Fully Convolutional Neural Networks (FCNs) usually represent the most successful approach to image segmentation. However, the success of these models is conditioned by an adequate selection and adaptation of the architectures and techniques used, as well as the availability of a large amount of annotated data. These two issues become specially relevant when applying FCNs to medical image segmentation as, first, the existent models are usually adjusted from broad domain applications over photographic images, and second, the amount of annotated data is usually scarcer. In this work, we present multimodal transfer learning-based approaches for retinal vascular segmentation, performing a comparative study of recent FCN architectures. In particular, to overcome the annotated data scarcity, we propose the novel application of self-supervised network pretraining that takes advantage of existent unlabelled multimodal data. The results demonstrate that the self-supervised pretrained networks obtain significantly better vascular masks with less training in the target task, independently of the network architecture, and that some FCN architecture advances motivated for broad domain applications do not translate into significant improvements over the vasculature segmentation task.

📄 PDF Abstract BibTeX arXiv:2012.10160

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationTransfer Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
FCN Fully Convolutional Networks, or FCNs, are an architecture used mainly for semantic segmentation. They employ solely locally connected layers, such as…

Similar Papers 제목 키워드 기반

Predicting Stroke through Retinal Graphs and Multimodal Self-supervised Learning

2024-11-08 · Yuqing Huang, Bastian Wittmann, Olga Demler, Bjoern Menze 외

Early identification of stroke is crucial for intervention, requiring reliable models. We proposed an efficient retinal image representation together with clinical information to capture a comprehensive overview of cardi…

Contrastive LearningSelf-Supervised LearningTransfer Learning

Transfer Learning Through Weighted Loss Function and Group Normalization for Vessel Segmentation from Retinal Images

2020-12-16 · Abdullah Sarhan, Jon Rokne, Reda Alhajj, Andrew Crichton

The vascular structure of blood vessels is important in diagnosing retinal conditions such as glaucoma and diabetic retinopathy. Accurate segmentation of these vessels can help in detecting retinal objects such as the op…

DecoderSegmentationTransfer Learning

Simultaneous segmentation and classification of the retinal arteries and veins from color fundus images

2022-09-20 · José Morano, Álvaro S. Hervella, Jorge Novo, José Rouco

The study of the retinal vasculature is a fundamental stage in the screening and diagnosis of many diseases. A complete retinal vascular analysis requires to segment and classify the blood vessels of the retina into arte…

ClassificationSegmentationSemantic Segmentation

Microvasculature Segmentation and Inter-capillary Area Quantification of the Deep Vascular Complex using Transfer Learning

2020-03-19 · Julian Lo, Morgan Heisler, Vinicius Vanzan, Sonja Karst 외

Purpose: Optical Coherence Tomography Angiography (OCT-A) permits visualization of the changes to the retinal circulation due to diabetic retinopathy (DR), a microvascular complication of diabetes. We demonstrate accurat…

Transfer Learning

RV-GAN: Segmenting Retinal Vascular Structure in Fundus Photographs using a Novel Multi-scale Generative Adversarial Network

2021-01-03 · Sharif Amit Kamran, Khondker Fariha Hossain, Alireza Tavakkoli, Stewart Lee Zuckerbrod 외

High fidelity segmentation of both macro and microvascular structure of the retina plays a pivotal role in determining degenerative retinal diseases, yet it is a difficult problem. Due to successive resolution loss in th…

DecoderGenerative Adversarial NetworkRetinal Vessel SegmentationSegmentation+1