paper-with-me

홈 › Papers

Multi-Modal Graph Neural Network with Transformer-Guided Adaptive Diffusion for Preclinical Alzheimer Classification

2026-06-02 · Jaeyoon Sim, Minjae Lee, Guorong Wu, Won Hwa Kim arxiv

The graphical representation of the brain offers critical insights into diagnosing and prognosing neurodegenerative disease via relationships between regions of interest (ROIs). Despite recent emergence of various Graph Neural Networks (GNNs) to effectively capture the relational information, there remain inherent limitations in interpreting the brain networks. Specifically, convolutional approaches ineffectively aggregate information from distant neighborhoods, while attention-based methods exhibit deficiencies in capturing node-centric information, particularly in retaining critical characteristics from pivotal nodes. These shortcomings reveal challenges for identifying disease-specific variation from diverse features from different modalities. In this regard, we propose an integrated framework guiding diffusion process at each node by a downstream transformer where both short- and long-range properties of graphs are aggregated via diffusion-kernel and multi-head attention respectively. We demonstrate the superiority of our model by improving performance of pre-clinical Alzheimer's disease (AD) classification with various modalities. Also, our model adeptly identifies key ROIs that are closely associated with the preclinical stages of AD, marking a significant potential for early diagnosis and prevision of the disease.

📄 PDF Abstract BibTeX arXiv:2606.03322

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural Network

Similar Papers 제목 키워드 기반

MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion

2026-07-17 · Xu Hou, Meiyu Liang, Wei Huang, Yawen Li 외 arxiv

Multimodal Knowledge Graph Completion (MKGC) requires inferring missing entities from structural, textual, and visual cues. Existing diffusion-based MKGC methods usually denoise directly on raw multimodal features. Such …

Knowledge Graph Completion

Multimodal Event Transformer for Image-guided Story Ending Generation

2023-01-26 · Yucheng Zhou, Guodong Long

Image-guided story ending generation (IgSEG) is to generate a story ending based on given story plots and ending image. Existing methods focus on cross-modal feature fusion but overlook reasoning and mining implicit info…

DecoderImage-guided Story Ending Generation

CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers

2023-05-27 · Dachuan Shi, Chaofan Tao, Anyi Rao, Zhendong Yang 외

Recent vision-language models have achieved tremendous advances. However, their computational costs are also escalating dramatically, making model acceleration exceedingly critical. To pursue more efficient vision-langua…

Image CaptioningImage RetrievalImage-text RetrievalImage-to-Text Retrieval+5

Scene Graph-guided SegCaptioning Transformer with Fine-grained Alignment for Controllable Video Segmentation and Captioning

2026-03-21 · Xu Zhang, Jin Yuan, BinHong Yang, Xuan Liu 외 arxiv

Recent advancements in multimodal large models have significantly bridged the representation gap between diverse modalities, catalyzing the evolution of video multimodal interpretation, which enhances users' understandin…

Video Segmentation

Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoning

2023-07-06 · Ke Liang, Sihang Zhou, Yue Liu, Lingyuan Meng 외

Multimodal knowledge graphs (MKGs), which intuitively organize information in various modalities, can benefit multiple practical downstream tasks, such as recommendation systems, and visual question answering. However, m…

Knowledge GraphsQuestion AnsweringRecommendation SystemsVisual Question Answering