paper-with-me

홈 › Papers

StudyFormer : Attention-Based and Dynamic Multi View Classifier for X-ray images

2023-02-23 · Lucas Wannenmacher, Michael Fitzke, Diane Wilson, Andre Dourson

Chest X-ray images are commonly used in medical diagnosis, and AI models have been developed to assist with the interpretation of these images. However, many of these models rely on information from a single view of the X-ray, while multiple views may be available. In this work, we propose a novel approach for combining information from multiple views to improve the performance of X-ray image classification. Our approach is based on the use of a convolutional neural network to extract feature maps from each view, followed by an attention mechanism implemented using a Vision Transformer. The resulting model is able to perform multi-label classification on 41 labels and outperforms both single-view models and traditional multi-view classification architectures. We demonstrate the effectiveness of our approach through experiments on a dataset of 363,000 X-ray images.

📄 PDF Abstract BibTeX arXiv:2302.11840

Code (0)

등록된 구현이 없습니다.

Tasks

Classificationimage-classificationImage ClassificationMedical DiagnosisMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Dynamic voting in multi-view learning for radiomics applications

2018-06-20 · Hongliu Cao, Simon Bernard, Laurent Heutte, Robert Sabourin

Cancer diagnosis and treatment often require a personalized analysis for each patient nowadays, due to the heterogeneity among the different types of tumor and among patients. Radiomics is a recent medical imaging field …

MULTI-VIEW LEARNING

User Bias Removal in Review Score Prediction

2016-12-20 · Rahul Wadbude, Vivek Gupta, Dheeraj Mekala, Harish Karnick

Review score prediction of text reviews has recently gained a lot of attention in recommendation systems. A major problem in models for review score prediction is the presence of noise due to user-bias in review scores. …

PredictionRecommendation Systems

Learn to Memorize and to Forget: A Continual Learning Perspective of Dynamic SLAM

2024-07-18 · Baicheng Li, Zike Yan, Dong Wu, Hanqing Jiang 외

Simultaneous localization and mapping (SLAM) with implicit neural representations has received extensive attention due to the expressive representation power and the innovative paradigm of continual learning. However, de…

Continual LearningSimultaneous Localization and Mapping

Pose-adaptive Hierarchical Attention Network for Facial Expression Recognition

2019-05-24 · Yuanyuan Liu, Jiyao Peng, Jiabei Zeng, Shiguang Shan

Multi-view facial expression recognition (FER) is a challenging task because the appearance of an expression varies in poses. To alleviate the influences of poses, recent methods either perform pose normalization or lear…

Facial Expression RecognitionFacial Expression Recognition (FER)

Active Classification of Moving Targets with Learned Control Policies

2022-12-06 · Álvaro Serra-Gómez, Eduardo Montijano, Wendelin Böhmer, Javier Alonso-Mora

In this paper, we consider the problem where a drone has to collect semantic information to classify multiple moving targets. In particular, we address the challenge of computing control inputs that move the drone to inf…

ClassificationReinforcement Learning (RL)