paper-with-me

Papers

Multi-modal brain MRI synthesis based on SwinUNETR

2025-06-03 · Haowen Pang, Weiyan Guo, Chuyang Ye

Multi-modal brain magnetic resonance imaging (MRI) plays a crucial role in clinical diagnostics by providing complementary information across different imaging modalities. However, a common challenge in clinical practice is missing MRI modalities. In this paper, we apply SwinUNETR to the synthesize of missing modalities in brain MRI. SwinUNETR is a novel neural network architecture designed for medical image analysis, integrating the strengths of Swin Transformer and convolutional neural networks (CNNs). The Swin Transformer, a variant of the Vision Transformer (ViT), incorporates hierarchical feature extraction and window-based self-attention mechanisms, enabling it to capture both local and global contextual information effectively. By combining the Swin Transformer with CNNs, SwinUNETR merges global context awareness with detailed spatial resolution. This hybrid approach addresses the challenges posed by the varying modality characteristics and complex brain structures, facilitating the generation of accurate and realistic synthetic images. We evaluate the performance of SwinUNETR on brain MRI datasets and demonstrate its superior capability in generating clinically valuable images. Our results show significant improvements in image quality, anatomical consistency, and diagnostic value.

📄 PDF Abstract BibTeX arXiv:2506.02467

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticMedical Image Analysis

Methods 이 논문이 사용한 방법론

Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Neuro-TransUNet: Segmentation of stroke lesion in MRI using transformers

2024-06-10 · Muhammad Nouman, Mohamed Mabrok, Essam A. Rashed

Accurate segmentation of the stroke lesions using magnetic resonance imaging (MRI) is associated with difficulties due to the complicated anatomy of the brain and the different properties of the lesions. This study intro…

AnatomyLesion SegmentationSegmentation

Hyper-Connections for Adaptive Multi-Modal MRI Brain Tumor Segmentation

2026-03-20 · Lokendra Kumar, Shubham Aggarwal arxiv

We present the first study of Hyper-Connections (HC) for volumetric multi-modal brain tumor segmentation, integrating them as a drop-in replacement for fixed residual connections across five architectures: nnU-Net, SwinU…

Medical Image SegmentationBrain Tumor Segmentation

Brain-Conditional Multimodal Synthesis: A Survey and Taxonomy

2023-12-31 · Weijian Mai, Jian Zhang, Pengfei Fang, Zhijun Zhang

In the era of Artificial Intelligence Generated Content (AIGC), conditional multimodal synthesis technologies (e.g., text-to-image, text-to-video, text-to-audio, etc) are gradually reshaping the natural content in the re…

Brain Computer InterfaceBrain DecodingSurvey

Generative Adversarial Networks for Brain Images Synthesis: A Review

2023-05-16 · Firoozeh Shomal Zadeh, Sevda Molani, Maysam Orouskhani, Marziyeh Rezaei 외

In medical imaging, image synthesis is the estimation process of one image (sequence, modality) from another image (sequence, modality). Since images with different modalities provide diverse biomarkers and capture vario…

Deep LearningGenerative Adversarial NetworkImage Generation

Towards General Text-guided Image Synthesis for Customized Multimodal Brain MRI Generation

2024-09-25 · Yulin Wang, Honglin Xiong, Kaicong Sun, Shuwei Bai 외

Multimodal brain magnetic resonance (MR) imaging is indispensable in neuroscience and neurology. However, due to the accessibility of MRI scanners and their lengthy acquisition time, multimodal MR images are not commonly…

Contrastive LearningImage Generation