paper-with-me

홈 › Papers

Multi-task learning for joint weakly-supervised segmentation and aortic arch anomaly classification in fetal cardiac MRI

2023-11-13 · Paula Ramirez, Alena Uus, Milou P. M. van Poppel, Irina Grigorescu, Johannes K. Steinweg, David F. A. Lloyd, Kuberan Pushparajah, Andrew P. King, Maria Deprez

Congenital Heart Disease (CHD) is a group of cardiac malformations present already during fetal life, representing the prevailing category of birth defects globally. Our aim in this study is to aid 3D fetal vessel topology visualisation in aortic arch anomalies, a group which encompasses a range of conditions with significant anatomical heterogeneity. We present a multi-task framework for automated multi-class fetal vessel segmentation from 3D black blood T2w MRI and anomaly classification. Our training data consists of binary manual segmentation masks of the cardiac vessels' region in individual subjects and fully-labelled anomaly-specific population atlases. Our framework combines deep learning label propagation using VoxelMorph with 3D Attention U-Net segmentation and DenseNet121 anomaly classification. We target 11 cardiac vessels and three distinct aortic arch anomalies, including double aortic arch, right aortic arch, and suspected coarctation of the aorta. We incorporate an anomaly classifier into our segmentation pipeline, delivering a multi-task framework with the primary motivation of correcting topological inaccuracies of the segmentation. The hypothesis is that the multi-task approach will encourage the segmenter network to learn anomaly-specific features. As a secondary motivation, an automated diagnosis tool may have the potential to enhance diagnostic confidence in a decision support setting. Our results showcase that our proposed training strategy significantly outperforms label propagation and a network trained exclusively on propagated labels. Our classifier outperforms a classifier trained exclusively on T2w volume images, with an average balanced accuracy of 0.99 (0.01) after joint training. Adding a classifier improves the anatomical and topological accuracy of all correctly classified double aortic arch subjects.

📄 PDF Abstract BibTeX arXiv:2311.07234

Code (1)

svrtk/masc-multi-task-segmentation-and-classification 공식 구현 pytorch

Tasks

Anomaly ClassificationDiagnosticMulti-Task LearningSegmentationWeakly supervised segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

Weakly Supervised Multi-Object Tracking and Segmentation

2021-01-03 · Idoia Ruiz, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder 외

We introduce the problem of weakly supervised Multi-Object Tracking and Segmentation, i.e. joint weakly supervised instance segmentation and multi-object tracking, in which we do not provide any kind of mask annotation. …

Instance SegmentationMulti-Object TrackingMulti-Object Tracking and SegmentationMulti-Task Learning+6

Cyclic Guidance for Weakly Supervised Joint Detection and Segmentation

2019-06-01 · CVPR 2019 6 · Yunhang Shen, Rongrong Ji, Yan Wang, Yongjian Wu 외

Weakly supervised learning has attracted growing research attention due to the significant saving in annotation cost for tasks that require intra-image annotations, such as object detection and semantic segmentation. To …

Image-level Supervised Instance SegmentationMulti-Task LearningObjectobject-detection+5

Joint Learning of Saliency Detection and Weakly Supervised Semantic Segmentation

2019-09-09 · ICCV 2019 10 · Yu Zeng, Yunzhi Zhuge, Huchuan Lu, Lihe Zhang

Existing weakly supervised semantic segmentation (WSSS) methods usually utilize the results of pre-trained saliency detection (SD) models without explicitly modeling the connections between the two tasks, which is not th…

Multi-Task LearningSaliency DetectionSegmentationSemantic Segmentation+3

Weakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Images

2021-04-04 · CVPR 2021 1 · Xinggang Wang, Jiapei Feng, Bin Hu, Qi Ding 외

Humans have a strong class-agnostic object segmentation ability and can outline boundaries of unknown objects precisely, which motivates us to propose a box-supervised class-agnostic object segmentation (BoxCaseg) based …

Box-supervised Instance SegmentationInstance SegmentationMulti-Task LearningObject+4

Weakly- and Semi-Supervised Panoptic Segmentation

2018-08-10 · ECCV 2018 9 · Qizhu Li, Anurag Arnab, Philip H. S. Torr

We present a weakly supervised model that jointly performs both semantic- and instance-segmentation -- a particularly relevant problem given the substantial cost of obtaining pixel-perfect annotation for these tasks. In …

Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation+3