paper-with-me

홈 › Papers

SuperFormer: Volumetric Transformer Architectures for MRI Super-Resolution

2024-06-05 · Cristhian Forigua, Maria Escobar, Pablo Arbelaez

This paper presents a novel framework for processing volumetric medical information using Visual Transformers (ViTs). First, We extend the state-of-the-art Swin Transformer model to the 3D medical domain. Second, we propose a new approach for processing volumetric information and encoding position in ViTs for 3D applications. We instantiate the proposed framework and present SuperFormer, a volumetric transformer-based approach for Magnetic Resonance Imaging (MRI) Super-Resolution. Our method leverages the 3D information of the MRI domain and uses a local self-attention mechanism with a 3D relative positional encoding to recover anatomical details. In addition, our approach takes advantage of multi-domain information from volume and feature domains and fuses them to reconstruct the High-Resolution MRI. We perform an extensive validation on the Human Connectome Project dataset and demonstrate the superiority of volumetric transformers over 3D CNN-based methods. Our code and pretrained models are available at https://github.com/BCV-Uniandes/SuperFormer.

📄 PDF Abstract BibTeX arXiv:2406.03359

Code (1)

bcv-uniandes/superformer 공식 구현 pytorch

Tasks

Super-Resolution

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Swin Transformer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

ViTAS: Vision Transformer Architecture Search

2021-06-25 · Xiu Su, Shan You, Jiyang Xie, Mingkai Zheng 외

Vision transformers (ViTs) inherited the success of NLP but their structures have not been sufficiently investigated and optimized for visual tasks. One of the simplest solutions is to directly search the optimal one via…

Inductive BiasNeural Architecture Search

Scaling Self-Supervised and Cross-Modal Pretraining for Volumetric CT Transformers

2025-11-21 · Cris Claessens, Christiaan Viviers, Giacomo D'Amicantonio, Egor Bondarev 외 arxiv

We introduce SPECTRE, a fully transformer-based foundation model for volumetric computed tomography (CT). Our Self-Supervised & Cross-Modal Pretraining for CT Representation Extraction (SPECTRE) approach utilizes scalabl…

Contrastive Learning

VolDiT: Controllable Volumetric Medical Image Synthesis with Diffusion Transformers

2026-03-26 · Marvin Seyfarth, Salman Ul Hassan Dar, Yannik Frisch, Philipp Wild 외 arxiv

Diffusion models have become a leading approach for high-fidelity medical image synthesis. However, most existing methods for 3D medical image generation rely on convolutional U-Net backbones within latent diffusion fram…

Medical Image Generation

RPLHR-CT Dataset and Transformer Baseline for Volumetric Super-Resolution from CT Scans

2022-06-13 · Pengxin Yu, Haoyue Zhang, Han Kang, Wen Tang 외

In clinical practice, anisotropic volumetric medical images with low through-plane resolution are commonly used due to short acquisition time and lower storage cost. Nevertheless, the coarse resolution may lead to diffic…

Medical DiagnosisSSIMSuper-Resolution

MTVNet: Mapping using Transformers for Volumes -- Network for Super-Resolution with Long-Range Interactions

2024-12-04 · August Leander Høeg, Sophia W. Bardenfleth, Hans Martin Kjer, Tim B. Dyrby 외

Until now, it has been difficult for volumetric super-resolution to utilize the recent advances in transformer-based models seen in 2D super-resolution. The memory required for self-attention in 3D volumes limits the rec…

Super-Resolution