paper-with-me

홈 › Papers

Multi-domain Integrative Swin Transformer network for Sparse-View Tomographic Reconstruction

2021-11-28 · Jiayi Pan, Heye Zhang, Weifei Wu, Zhifan Gao, Weiwen Wu

Decreasing projection views to lower X-ray radiation dose usually leads to severe streak artifacts. To improve image quality from sparse-view data, a Multi-domain Integrative Swin Transformer network (MIST-net) was developed in this article. First, MIST-net incorporated lavish domain features from data, residual-data, image, and residual-image using flexible network architectures, where residual-data and residual-image sub-network was considered as data consistency module to eliminate interpolation and reconstruction errors. Second, a trainable edge enhancement filter was incorporated to detect and protect image edges. Third, a high-quality reconstruction Swin transformer (i.e., Recformer) was designed to capture image global features. The experiment results on numerical and real cardiac clinical datasets with 48-views demonstrated that our proposed MIST-net provided better image quality with more small features and sharp edges than other competitors.

📄 PDF Abstract BibTeX arXiv:2111.14831

Code (0)

등록된 구현이 없습니다.

Tasks

Image Reconstruction

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

SparseSwin: Swin Transformer with Sparse Transformer Block

2023-09-11 · Krisna Pinasthika, Blessius Sheldo Putra Laksono, Riyandi Banovbi Putera Irsal, Syifa Hukma Shabiyya 외

Advancements in computer vision research have put transformer architecture as the state of the art in computer vision tasks. One of the known drawbacks of the transformer architecture is the high number of parameters, th…

image-classificationImage Classification

SwInception -- Local Attention Meets Convolutions

2026-05-28 · David Hagerman, Roman Naeem, Jakob Lindqvist, Carl Lindström 외 arxiv

Sparse vision transformers have gained popularity as efficient encoders for medical volumetric segmentation, with Swin emerging as a prominent choice. Swin uses local attention to reduce complexity and yields excellent p…

Image Segmentation

gSwin: Gated MLP Vision Model with Hierarchical Structure of Shifted Window

2022-08-24 · Mocho Go, Hideyuki Tachibana

Following the success in language domain, the self-attention mechanism (transformer) is adopted in the vision domain and achieving great success recently. Additionally, as another stream, multi-layer perceptron (MLP) is …

image-classificationImage ClassificationInstance Segmentationobject-detection+2

SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning

2021-11-25 · CVPR 2022 1 · Kevin Lin, Linjie Li, Chung-Ching Lin, Faisal Ahmed 외

The canonical approach to video captioning dictates a caption generation model to learn from offline-extracted dense video features. These feature extractors usually operate on video frames sampled at a fixed frame rate …

Caption GenerationQuestion AnsweringVideo CaptioningVideo Question Answering+1

Speech Swin-Transformer: Exploring a Hierarchical Transformer with Shifted Windows for Speech Emotion Recognition

2024-01-19 · Yong Wang, Cheng Lu, Hailun Lian, Yan Zhao 외

Swin-Transformer has demonstrated remarkable success in computer vision by leveraging its hierarchical feature representation based on Transformer. In speech signals, emotional information is distributed across different…

Emotion RecognitionSpeech Emotion Recognition