Tempera: Spatial Transformer Feature Pyramid Network for Cardiac MRI Segmentation

2022-03-01 · Christoforos Galazis, Huiyi Wu, Zhuoyu Li, Camille Petri, Anil A. Bharath, Marta Varela

Assessing the structure and function of the right ventricle (RV) is important in the diagnosis of several cardiac pathologies. However, it remains more challenging to segment the RV than the left ventricle (LV). In this paper, we focus on segmenting the RV in both short (SA) and long-axis (LA) cardiac MR images simultaneously. For this task, we propose a new multi-input/output architecture, hybrid 2D/3D geometric spatial TransformEr Multi-Pass fEature pyRAmid (Tempera). Our feature pyramid extends current designs by allowing not only a multi-scale feature output but multi-scale SA and LA input images as well. Tempera transfers learned features between SA and LA images via layer weight sharing and incorporates a geometric target transformer to map the predicted SA segmentation to LA space. Our model achieves an average Dice score of 0.836 and 0.798 for the SA and LA, respectively, and 26.31 mm and 31.19 mm Hausdorff distances. This opens up the potential for the incorporation of RV segmentation models into clinical workflows.

📄 PDF Abstract BibTeX arXiv:2203.00355

Code (1)

cgalaz01/mnms2_challenge 공식 구현 tf

Tasks

MRI segmentation

Methods 이 논문이 사용한 방법론

Spatial Transformer A Spatial Transformer is an image model block that explicitly allows the spatial manipulation of data within a [convolutional neural…

MCSeg: Pre-training and Fine-tuning Volumetric Pyramid Transformer for Multi-modal Cardiac Image Segmentation

2026-08-31 · Zhiyu Ye, Hairong Zheng, Tong Zhang arxiv

Automatic cardiac image segmentation is pivotal for diagnosing and treating cardiac diseases. In this work, we introduce MCSeg, a volumetric transformer-based network tailored for multi-modal cardiac segmentation. To ove…

Image Segmentation

Feature Pyramid Transformer

2020-07-18 · ECCV 2020 8 · Dong Zhang, Hanwang Zhang, Jinhui Tang, Meng Wang 외

Feature interactions across space and scales underpin modern visual recognition systems because they introduce beneficial visual contexts. Conventionally, spatial contexts are passively hidden in the CNN's increasing rec…

Instance Segmentation object-detection Object Detection Segmentation+1

Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation

2020-06-28 · Hanchao Yu, Xiao Chen, Humphrey Shi, Terrence Chen 외

Cardiac motion estimation plays a key role in MRI cardiac feature tracking and function assessment such as myocardium strain. In this paper, we propose Motion Pyramid Networks, a novel deep learning-based approach for ac…

Knowledge Distillation Motion Estimation

An Iterative Multi‐path Fully Convolutional Neural Network for Automatic Cardiac Segmentation in Cine MR Images

2019-11-01 · MEd Phy 2019 11 · Zongqing Ma 1, Xi Wu 2, Xin Wang 3, Qi Song 3 외

Purpose: Segmentation of the left ventricle (LV), right ventricle (RV) cavities and the myocardium (MYO) from cine cardiac magnetic resonance (MR) images is an important step for diagnosis and monitoring cardiac diseases…

Cardiac Segmentation LV Segmentation Segmentation

Steerable Pyramid Transform Enables Robust Left Ventricle Quantification

2022-01-20 · Xiangyang Zhu, Kede Ma, Wufeng Xue

Predicting cardiac indices has long been a focal point in the medical imaging community. While various deep learning models have demonstrated success in quantifying cardiac indices, they remain susceptible to mild input …