paper-with-me

홈 › Papers

DS-ViT: Dual-Stream Vision Transformer for Cross-Task Distillation in Alzheimer's Early Diagnosis

2024-09-11 · Ke Chen, Yifeng Wang, Yufei Zhou, Haohan Wang

In the field of Alzheimer's disease diagnosis, segmentation and classification tasks are inherently interconnected. Sharing knowledge between models for these tasks can significantly improve training efficiency, particularly when training data is scarce. However, traditional knowledge distillation techniques often struggle to bridge the gap between segmentation and classification due to the distinct nature of tasks and different model architectures. To address this challenge, we propose a dual-stream pipeline that facilitates cross-task and cross-architecture knowledge sharing. Our approach introduces a dual-stream embedding module that unifies feature representations from segmentation and classification models, enabling dimensional integration of these features to guide the classification model. We validated our method on multiple 3D datasets for Alzheimer's disease diagnosis, demonstrating significant improvements in classification performance, especially on small datasets. Furthermore, we extended our pipeline with a residual temporal attention mechanism for early diagnosis, utilizing images taken before the atrophy of patients' brain mass. This advancement shows promise in enabling diagnosis approximately six months earlier in mild and asymptomatic stages, offering critical time for intervention.

📄 PDF Abstract BibTeX arXiv:2409.07584

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationKnowledge DistillationSegmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Two-Stream Transformer for Multi-Label Image Classification

2022-10-01 · ACMMM 2022 10 · Xuelin Zhu, Jiuxin Cao, Jiawei Ge, Weijia Liu 외

Multi-label image classification is a fundamental yet challenging task in computer vision that aims to identify multiple objects from a given image. Recent studies on this task mainly focus on learning cross-modal intera…

Classificationimage-classificationImage ClassificationMulti-Label Image Classification+1

Dual-stream Network for Visual Recognition

2021-05-31 · NeurIPS 2021 12 · Mingyuan Mao, Renrui Zhang, Honghui Zheng, Peng Gao 외

Transformers with remarkable global representation capacities achieve competitive results for visual tasks, but fail to consider high-level local pattern information in input images. In this paper, we present a generic D…

image-classificationImage ClassificationInstance Segmentationobject-detection+2

Dual-Stream Attention Transformers for Sewer Defect Classification

2023-11-07 · Abdullah Al Redwan Newaz, Mahdi Abdeldguerfi, Kendall N. Niles, Joe Tom

We propose a dual-stream multi-scale vision transformer (DS-MSHViT) architecture that processes RGB and optical flow inputs for efficient sewer defect classification. Unlike existing methods that combine the predictions …

ClassificationOptical Flow Estimation

Joint rotational invariance and adversarial training of a dual-stream Transformer yields state of the art Brain-Score for Area V4

2022-03-08 · William Berrios, Arturo Deza

Modern high-scoring models of vision in the brain score competition do not stem from Vision Transformers. However, in this paper, we provide evidence against the unexpected trend of Vision Transformers (ViT) being not pe…

Adversarial Robustness

ResiDual Transformer Alignment with Spectral Decomposition

2024-10-31 · Lorenzo Basile, Valentino Maiorca, Luca Bortolussi, Emanuele Rodolà 외

When examined through the lens of their residual streams, a puzzling property emerges in transformer networks: residual contributions (e.g., attention heads) sometimes specialize in specific tasks or input attributes. In…

zero-shot-classificationZero-Shot Learning