paper-with-me

Papers

Self-Attention Equipped Graph Convolutions for Disease Prediction

2018-12-24 · Anees Kazi, S. Arvind krishna, Shayan Shekarforoush, Karsten Kortuem, Shadi Albarqouni, Nassir Navab

Multi-modal data comprising imaging (MRI, fMRI, PET, etc.) and non-imaging (clinical test, demographics, etc.) data can be collected together and used for disease prediction. Such diverse data gives complementary information about the patient\'s condition to make an informed diagnosis. A model capable of leveraging the individuality of each multi-modal data is required for better disease prediction. We propose a graph convolution based deep model which takes into account the distinctiveness of each element of the multi-modal data. We incorporate a novel self-attention layer, which weights every element of the demographic data by exploring its relation to the underlying disease. We demonstrate the superiority of our developed technique in terms of computational speed and performance when compared to state-of-the-art methods. Our method outperforms other methods with a significant margin.

📄 PDF Abstract BibTeX arXiv:1812.09954

Code (0)

등록된 구현이 없습니다.

Tasks

Disease PredictionPrediction

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Improving Graph Representation for Point Cloud Segmentation via Attentive Filtering

2023-01-01 · CVPR 2023 1 · Nan Zhang, Zhiyi Pan, Thomas H. Li, Wei Gao 외

Recently, self-attention networks achieve impressive performance in point cloud segmentation due to their superiority in modeling long-range dependencies. However, compared to self-attention mechanism, we find graph …

Point Cloud Segmentation

Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models

2021-06-10 · ACL 2021 5 · Tyler A. Chang, Yifan Xu, Weijian Xu, Zhuowen Tu

In this paper, we detail the relationship between convolutions and self-attention in natural language tasks. We show that relative position embeddings in self-attention layers are equivalent to recently-proposed dynamic …

Language ModelingLanguage ModellingPosition

Parkinson's Disease Detection from Resting State EEG using Multi-Head Graph Structure Learning with Gradient Weighted Graph Attention Explanations

2024-08-01 · Christopher Neves, Yong Zeng, Yiming Xiao

Parkinson's disease (PD) is a debilitating neurodegenerative disease that has severe impacts on an individual's quality of life. Compared with structural and functional MRI-based biomarkers for the disease, electroenceph…

Contrastive LearningEEGGraph AttentionGraph Neural Network+1

Graph Convolutions Enrich the Self-Attention in Transformers!

2023-12-07 · Jeongwhan Choi, Hyowon Wi, Jayoung Kim, Yehjin Shin 외

Transformers, renowned for their self-attention mechanism, have achieved state-of-the-art performance across various tasks in natural language processing, computer vision, time-series modeling, etc. However, one of the c…

Clone DetectionCode ClassificationDefect Detection+5

Pay Less Attention with Lightweight and Dynamic Convolutions

2019-01-29 · ICLR 2019 5 · Felix Wu, Angela Fan, Alexei Baevski, Yann N. Dauphin 외

Self-attention is a useful mechanism to build generative models for language and images. It determines the importance of context elements by comparing each element to the current time step. In this paper, we show that a …

Abstractive Text SummarizationLanguage ModelingLanguage ModellingMachine Translation+1