Neural Style Transfer Improves 3D Cardiovascular MR Image Segmentation on Inconsistent Data
Three-dimensional medical image segmentation is one of the most important problems in medical image analysis and plays a key role in downstream diagnosis and treatment. Recent years, deep neural networks have made groundbreaking success in medical image segmentation problem. However, due to the high variance in instrumental parameters, experimental protocols, and subject appearances, the generalization of deep learning models is often hindered by the inconsistency in medical images generated by different machines and hospitals. In this work, we present StyleSegor, an efficient and easy-to-use strategy to alleviate this inconsistency issue. Specifically, neural style transfer algorithm is applied to unlabeled data in order to minimize the differences in image properties including brightness, contrast, texture, etc. between the labeled and unlabeled data. We also apply probabilistic adjustment on the network output and integrate multiple predictions through ensemble learning. On a publicly available whole heart segmentation benchmarking dataset from MICCAI HVSMR 2016 challenge, we have demonstrated an elevated dice accuracy surpassing current state-of-the-art method and notably, an improvement of the total score by 29.91\%. StyleSegor is thus corroborated to be an accurate tool for 3D whole heart segmentation especially on highly inconsistent data, and is available at https://github.com/horsepurve/StyleSegor.
Code (1)
Tasks
BenchmarkingEnsemble LearningHeart SegmentationImage SegmentationMedical Image AnalysisMedical Image SegmentationSegmentationSemantic SegmentationStyle TransferSimilar Papers 제목 키워드 기반
Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networks
Recent research has investigated the shape and texture biases of deep neural networks (DNNs) in image classification which influence their generalization capabilities and robustness. It has been shown that, in comparison…
image-classificationImage ClassificationSegmentationSemantic Segmentation+1Automated Deep Photo Style Transfer
Photorealism is a complex concept that cannot easily be formulated mathematically. Deep Photo Style Transfer is an attempt to transfer the style of a reference image to a content image while preserving its photorealism. …
Image SegmentationSegmentationSemantic SegmentationStyle TransferImproved Object-Based Style Transfer with Single Deep Network
This research paper proposes a novel methodology for image-to-image style transfer on objects utilizing a single deep convolutional neural network. The proposed approach leverages the You Only Look Once version 8 (YOLOv8…
ObjectSegmentationStyle TransferCounterfactual Explanations for Survival Prediction of Cardiovascular ICU Patients
In recent years, machine learning methods have been rapidly implemented in the medical domain. However, current state-of-the-art methods usually produce opaque, black-box models. To address the lack of model transparency…
counterfactualCounterfactual ExplanationInterpretable Machine LearningPrediction+3Class-Based Styling: Real-time Localized Style Transfer with Semantic Segmentation
We propose a Class-Based Styling method (CBS) that can map different styles for different object classes in real-time. CBS achieves real-time performance by carrying out two steps simultaneously. While a semantic segment…
ObjectSegmentationSemantic SegmentationStyle Transfer