Incomplete Multi-modal Brain Tumor Segmentation via Learnable Sorting State Space Model

2025-01-01 · CVPR 2025 1 · Zheyu Zhang, Yayuan Lu, Feipeng Ma, Yueyi Zhang, Huanjing Yue, Xiaoyan Sun

Brain tumor segmentation plays a crucial role in clinical diagnosis, yet the frequent unavailability of certain MRI modalities poses a significant challenge. In this paper, we introduce the Learnable Sorting State Space Model (LS3M), a novel framework designed to maximize the utilization of available modalities for brain tumor segmentation. LS3M excels at efficiently modeling long-range dependencies based on the Mamba design, while incorporating differentiable permutation matrices that reorder input sequences based on modality-specific characteristics. This dynamic reordering ensures that critical spatial inductive biases and long-range semantic correlations inherent in 3D brain MRI are preserved, which is crucial for imcomplete multi-modal brain tumor segmentation.Once the input sequences are reordered using the generated permutation matrix, the Series State Space Model (S3M) block models the relationships between them, capturing both local and long-range dependencies. This enables effective representation of intra-modal and inter-modal relationships, significantly improving segmentation accuracy. Extensive experiments on the BraTS2018 and BraTS2020 datasets demonstrate that LS3M outperforms existing methods, offering a robust solution for brain tumor segmentation, particularly in scenarios with missing modalities.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Brain Tumor SegmentationMambaSegmentation Tumor Segmentation

Methods 이 논문이 사용한 방법론

Mamba Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.…

mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentation

2022-06-06 · Yao Zhang, Nanjun He, Jiawei Yang, Yuexiang Li 외

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and…

Brain Tumor Segmentation Decoder Segmentation Semantic Segmentation+1

RFNet: Region-Aware Fusion Network for Incomplete Multi-Modal Brain Tumor Segmentation

2021-01-01 · ICCV 2021 10 · Yuhang Ding, Xin Yu, Yi Yang

Most existing brain tumor segmentation methods usually exploit multi-modal magnetic resonance imaging (MRI) images to achieve high segmentation performance. However, the problem of missing certain modality images oft…

Brain Tumor Segmentation Segmentation Semantic Segmentation Tumor Segmentation

DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans

2022-11-15 · Haoran Li, Cheng Li, Weijian Huang, Xiawu Zheng 외

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performanc…

Brain Tumor Segmentation Image Segmentation Segmentation Semantic Segmentation+2

Enhancing Incomplete Multi-modal Brain Tumor Segmentation with Intra-modal Asymmetry and Inter-modal Dependency

2024-06-14 · Weide Liu, Jingwen Hou, Xiaoyang Zhong, Huijing Zhan 외

Deep learning-based brain tumor segmentation (BTS) models for multi-modal MRI images have seen significant advancements in recent years. However, a common problem in practice is the unavailability of some modalities due …

Anatomy Brain Tumor Segmentation Image Segmentation Medical Image Segmentation+3

Decoupling Feature Representations of Ego and Other Modalities for Incomplete Multi-modal Brain Tumor Segmentation

2024-08-16 · Kaixiang Yang, Wenqi Shan, Xudong Li, Xuan Wang 외

Multi-modal brain tumor segmentation typically involves four magnetic resonance imaging (MRI) modalities, while incomplete modalities significantly degrade performance. Existing solutions employ explicit or implicit moda…

Brain Tumor Segmentation Tumor Segmentation