paper-with-me

Papers

Magnetic Resonance Image Processing Transformer for General Accelerated Image Reconstruction

2024-05-23 · Guoyao Shen, Mengyu Li, Stephan Anderson, Chad W. Farris, Xin Zhang

Recent advancements in deep learning have enabled the development of generalizable models that achieve state-of-the-art performance across various imaging tasks. Vision Transformer (ViT)-based architectures, in particular, have demonstrated strong feature extraction capabilities when pre-trained on large-scale datasets. In this work, we introduce the Magnetic Resonance Image Processing Transformer (MR-IPT), a ViT-based framework designed to enhance the generalizability and robustness of accelerated MRI reconstruction. Unlike conventional deep learning models that require separate training for different acceleration factors, MR-IPT is pre-trained on a large-scale dataset encompassing multiple undersampling patterns and acceleration settings, enabling a unified reconstruction framework. By leveraging a shared transformer backbone, MR-IPT effectively learns universal feature representations, allowing it to generalize across diverse reconstruction tasks. Extensive experiments demonstrate that MR-IPT outperforms both CNN-based and existing transformer-based methods, achieving superior reconstruction quality across varying acceleration factors and sampling masks. Moreover, MR-IPT exhibits strong robustness, maintaining high performance even under unseen acquisition setups, highlighting its potential as a scalable and efficient solution for accelerated MRI. Our findings suggest that transformer-based general models can significantly advance MRI reconstruction, offering improved adaptability and stability compared to traditional deep learning approaches.

📄 PDF Abstract BibTeX arXiv:2405.15098

Code (0)

등록된 구현이 없습니다.

Tasks

AnatomyDeep LearningFew-Shot LearningImage ReconstructionMRI ReconstructionSSIMTransfer LearningZero-Shot Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

The relation between color spaces and compositional data analysis demonstrated with magnetic resonance image processing applications

2018-06-11

This paper presents a novel application of compositional data analysis methods in the context of color image processing. A vector decomposition method is proposed to reveal compositional components of any vector with pos…

MR-Transformer: Vision Transformer for Total Knee Replacement Prediction Using Magnetic Resonance Imaging

2024-05-05 · Chaojie Zhang, Shengjia Chen, Ozkan Cigdem, Haresh Rengaraj Rajamohan 외

A transformer-based deep learning model, MR-Transformer, was developed for total knee replacement (TKR) prediction using magnetic resonance imaging (MRI). The model incorporates the ImageNet pre-training and captures thr…

Deep LearningPrediction

ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer

2022-01-23 · Pengfei Guo, Yiqun Mei, Jinyuan Zhou, Shanshan Jiang 외

Accelerating magnetic resonance image (MRI) reconstruction process is a challenging ill-posed inverse problem due to the excessive under-sampling operation in k-space. In this paper, we propose a recurrent transformer mo…

Feature CorrelationMRI Reconstruction

FaBiAN: A Fetal Brain magnetic resonance Acquisition Numerical phantom

2021-09-06 · Hélène Lajous, Christopher W. Roy, Tom Hilbert, Priscille de Dumast 외

Accurate characterization of in utero human brain maturation is critical as it involves complex and interconnected structural and functional processes that may influence health later in life. Magnetic resonance imaging i…

Super-Resolution

Multi-modal Deep Guided Filtering for Comprehensible Medical Image Processing

2019-11-18 · Bernhard Stimpel, Christopher Syben, Franziska Schirrmacher, Philipp Hoelter 외

Deep learning-based image processing is capable of creating highly appealing results. However, it is still widely considered as a "blackbox" transformation. In medical imaging, this lack of comprehensibility of the resul…

Deep LearningDenoisingImage Super-ResolutionSuper-Resolution