paper-with-me

홈 › Papers

HydraViT: Adaptive Multi-Branch Transformer for Multi-Label Disease Classification from Chest X-ray Images

2023-10-09 · Şaban Öztürk, M. Yiğit Turalı, Tolga Çukur

Chest X-ray is an essential diagnostic tool in the identification of chest diseases given its high sensitivity to pathological abnormalities in the lungs. However, image-driven diagnosis is still challenging due to heterogeneity in size and location of pathology, as well as visual similarities and co-occurrence of separate pathology. Since disease-related regions often occupy a relatively small portion of diagnostic images, classification models based on traditional convolutional neural networks (CNNs) are adversely affected given their locality bias. While CNNs were previously augmented with attention maps or spatial masks to guide focus on potentially critical regions, learning localization guidance under heterogeneity in the spatial distribution of pathology is challenging. To improve multi-label classification performance, here we propose a novel method, HydraViT, that synergistically combines a transformer backbone with a multi-branch output module with learned weighting. The transformer backbone enhances sensitivity to long-range context in X-ray images, while using the self-attention mechanism to adaptively focus on task-critical regions. The multi-branch output module dedicates an independent branch to each disease label to attain robust learning across separate disease classes, along with an aggregated branch across labels to maintain sensitivity to co-occurrence relationships among pathology. Experiments demonstrate that, on average, HydraViT outperforms competing attention-guided methods by 1.2%, region-guided methods by 1.4%, and semantic-guided methods by 1.0% in multi-label classification performance.

📄 PDF Abstract BibTeX arXiv:2310.06143

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSensitivity

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

HydraViT: Stacking Heads for a Scalable ViT

2024-09-26 · Janek Haberer, Ali Hojjat, Olaf Landsiedel

The architecture of Vision Transformers (ViTs), particularly the Multi-head Attention (MHA) mechanism, imposes substantial hardware demands. Deploying ViTs on devices with varying constraints, such as mobile phones, requ…

Slimmable ConvNeXt: Width-Adaptive Inference for Efficient Multi-Device Deployment

2026-05-21 · Janek Haberer, Jon Eike Wilhelm, Olaf Landsiedel arxiv

Deploying vision models across devices with varying resource constraints, or even on a single device where available compute fluctuates due to battery state, thermal throttling, or latency deadlines, typically requires t…

Dual-branch Attention-In-Attention Transformer for single-channel speech enhancement

2021-10-13 · Guochen Yu, Andong Li, Chengshi Zheng, Yinuo Guo 외

Curriculum learning begins to thrive in the speech enhancement area, which decouples the original spectrum estimation task into multiple easier sub-tasks to achieve better performance. Motivated by that, we propose a dua…

Speech Enhancement

RAViT: Resolution-Adaptive Vision Transformer

2026-02-27 · Martial Guidez, Stefan Duffner, Christophe Garcia arxiv

Vision transformers have recently made a breakthrough in computer vision showing excellent performance in terms of precision for numerous applications. However, their computational cost is very high compared to alternati…

Image Classification

RGBT Tracking via Progressive Fusion Transformer with Dynamically Guided Learning

2023-03-26 · Yabin Zhu, Chenglong Li, Xiao Wang, Jin Tang 외

Existing Transformer-based RGBT tracking methods either use cross-attention to fuse the two modalities, or use self-attention and cross-attention to model both modality-specific and modality-sharing information. However,…