paper-with-me

Papers

Fast MRI Reconstruction: How Powerful Transformers Are?

2022-01-23 · Jiahao Huang, Yinzhe Wu, Huanjun Wu, Guang Yang

Magnetic resonance imaging (MRI) is a widely used non-radiative and non-invasive method for clinical interrogation of organ structures and metabolism, with an inherently long scanning time. Methods by k-space undersampling and deep learning based reconstruction have been popularised to accelerate the scanning process. This work focuses on investigating how powerful transformers are for fast MRI by exploiting and comparing different novel network architectures. In particular, a generative adversarial network (GAN) based Swin transformer (ST-GAN) was introduced for the fast MRI reconstruction. To further preserve the edge and texture information, edge enhanced GAN based Swin transformer (EES-GAN) and texture enhanced GAN based Swin transformer (TES-GAN) were also developed, where a dual-discriminator GAN structure was applied. We compared our proposed GAN based transformers, standalone Swin transformer and other convolutional neural networks based GAN model in terms of the evaluation metrics PSNR, SSIM and FID. We showed that transformers work well for the MRI reconstruction from different undersampling conditions. The utilisation of GAN's adversarial structure improves the quality of images reconstructed when undersampled for 30% or higher. The code is publicly available at https://github.com/ayanglab/SwinGANMR.

📄 PDF Abstract BibTeX arXiv:2201.09400

Code (1)

ayanglab/swinganmr 공식 구현 pytorch

Tasks

Generative Adversarial NetworkMRI Reconstruction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Vision Transformers: State of the Art and Research Challenges

2022-07-07 · Bo-Kai Ruan, Hong-Han Shuai, Wen-Huang Cheng

Transformers have achieved great success in natural language processing. Due to the powerful capability of self-attention mechanism in transformers, researchers develop the vision transformers for a variety of computer v…

3D ReconstructionImage Segmentationobject-detectionObject Detection+3

Scale-Wise VAR is Secretly Discrete Diffusion

2025-09-26 · Amandeep Kumar, Nithin Gopalakrishnan Nair, Vishal M. Patel arxiv

Autoregressive (AR) transformers have emerged as a powerful paradigm for visual generation, largely due to their scalability, computational efficiency and unified architecture with language and vision. Among them, next s…

Computational Efficiency

HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction

2022-03-15 · Zalan Fabian, Berk Tınaz, Mahdi Soltanolkotabi

In accelerated MRI reconstruction, the anatomy of a patient is recovered from a set of under-sampled and noisy measurements. Deep learning approaches have been proven to be successful in solving this ill-posed inverse pr…

AnatomyMRI Reconstruction

TurboVGGT: Fast Visual Geometry Reconstruction with Adaptive Alternating Attention

2026-05-14 · David Huang, Guile Wu, Chengjie Huang, Bingbing Liu 외 arxiv

Recent feed-forward 3D reconstruction methods, such as visual geometry transformers, have substantially advanced the traditional per-scene optimization paradigm by enabling effective multi-view reconstruction in a single…

Multi-View 3D ReconstructionComputational Efficiency

GPAIR: Gaussian-Kernel-Based Ultrafast 3D Photoacoustic Iterative Reconstruction

2026-02-03 · Yibing Wang, Shuang Li, Tingting Huang, Yu Zhang 외 arxiv

Although the iterative reconstruction (IR) algorithm can substantially correct reconstruction artifacts in photoacoustic (PA) computed tomography (PACT), it suffers from long reconstruction times, especially for large-sc…

Image Reconstruction