paper-with-me

홈 › Papers

Splitting expands the application range of Vision Transformer -- variable Vision Transformer (vViT)

2022-11-08 · Takuma Usuzaki

Vision Transformer (ViT) has achieved outstanding results in computer vision. Although there are many Transformer-based architectures derived from the original ViT, the dimension of patches are often the same with each other. This disadvantage leads to a limited application range in the medical field because in the medical field, datasets whose dimension is different from each other; e.g. medical image, patients' personal information, laboratory test and so on. To overcome this limitation, we develop a new derived type of ViT termed variable Vision Transformer (vViT). The aim of this study is to introduce vViT and to apply vViT to radiomics using T1 weighted magnetic resonance image (MRI) of glioma. In the prediction of 365 days of survival among glioma patients using radiomics,vViT achieved 0.83, 0.82, 0.81, and 0.76 in sensitivity, specificity, accuracy, and AUC-ROC, respectively. vViT has the potential to handle different types of medical information at once.

📄 PDF Abstract BibTeX arXiv:2211.03992

Code (0)

등록된 구현이 없습니다.

Tasks

Specificity

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Test 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Bilateral Network with Channel Splitting Network and Transformer for Thermal Image Super-Resolution

2022-06-24 · Bo Yan, Leilei Cao, Fengliang Qi, Hongbin Wang

In recent years, the Thermal Image Super-Resolution (TISR) problem has become an attractive research topic. TISR would been used in a wide range of fields, including military, medical, agricultural and animal ecology. Du…

Image Super-ResolutionSSIMSuper-Resolution

IO Transformer: Evaluating SwinV2-Based Reward Models for Computer Vision

2024-10-31 · Maxwell Meyer, Jack Spruyt

Transformers and their derivatives have achieved state-of-the-art performance across text, vision, and speech recognition tasks. However, minimal effort has been made to train transformers capable of evaluating the outpu…

Protein sequence classification using natural language processing techniques

2024-09-06 · Huma Perveen, Julie Weeds

Purpose: This study aimed to enhance protein sequence classification using natural language processing (NLP) techniques while addressing the impact of sequence similarity on model performance. We compared various machine…

Classification

CascadedViT: Cascaded Chunk-FeedForward and Cascaded Group Attention Vision Transformer

2025-11-18 · Srivathsan Sivakumar, Faisal Z. Qureshi arxiv

Vision Transformers (ViTs) have demonstrated remarkable performance across a range of computer vision tasks; however, their high computational, memory, and energy demands hinder deployment on resource-constrained platfor…

Accelerator-driven Data Arrangement to Minimize Transformers Run-time on Multi-core Architectures

2023-12-20 · Alireza Amirshahi, Giovanni Ansaloni, David Atienza

The increasing complexity of transformer models in artificial intelligence expands their computational costs, memory usage, and energy consumption. Hardware acceleration tackles the ensuing challenges by designing proces…