paper-with-me

홈 › Papers

Multimodal Graph Representation Learning with Dynamic Information Pathways

2026-03-10 · Xiaobin Hong, Mingkai Lin, Xiaoli Wang, Chaoqun Wang, Wenzhong Li arxiv

Multimodal graphs, where nodes contain heterogeneous features such as images and text, are increasingly common in real-world applications. Effectively learning on such graphs requires both adaptive intra-modal message passing and efficient inter-modal aggregation. However, most existing approaches to multimodal graph learning are typically extended from conventional graph neural networks and rely on static structures or dense attention, which limit flexibility and expressive node embedding learning. In this paper, we propose a novel multimodal graph representation learning framework with Dynamic information Pathways (DiP). By introducing modality-specific pseudo nodes, DiP enables dynamic message routing within each modality via proximity-guided pseudo-node interactions and captures inter-modality dependence through efficient information pathways in a shared state space. This design achieves adaptive, expressive, and sparse message propagation across modalities with linear complexity. We conduct the link prediction and node classification tasks to evaluate performance and carry out full experimental analyses. Extensive experiments across multiple benchmarks demonstrate that DiP consistently outperforms baselines.

📄 PDF Abstract BibTeX arXiv:2603.09258

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Representation LearningNode ClassificationLink PredictionGraph Learning

Similar Papers 제목 키워드 기반

ProtoPathway: Biologically Structured Prototype-Pathway Fusion for Multimodal Cancer Survival Prediction

2026-05-20 · Amaya Gallagher-Syed, Costantino Pitzalis, Myles J. Lewis, Michael R. Barnes 외 arxiv

We introduce ProtoPathway, an interpretable-by-design multimodal framework for cancer survival prediction that unifies whole slide imaging and transcriptomics through encoders producing biologically grounded representati…

Graph Neural Network

NeuroPath: Brain-Inspired Dual-Pathway Graph Convolutional Networks for Skeleton-Based Action Recognition

2026-08-18 · Kanglei Zhou, Ruizhi Cai, Hubert P. H. Shum, Frederick W. B. Li 외 arxiv

Skeleton-based action recognition aims to recognize human actions from sequences of human joint coordinates. Most existing Spatial-Temporal Graph Convolutional Networks (STGCNs) have achieved promising results by modelin…

Action Recognition

Finding Thermodynamically Favorable Pathways in Chemical Reaction Networks Using Flows in Hypergraphs and Mixed-Integer Linear Programming

2024-11-24 · Adittya Pal, Rolf Fagerberg, Jakob Lykke Andersen, Christoph Flamm 외

The search for pathways that optimize the formation of a particular target molecule in a reaction network is a key problem in many settings, including reactor systems. Chemical reaction networks are mathematically well r…

Cell cycle and protein complex dynamics in discovering signaling pathways

2020-02-26 · Daniel Inostroza, Cecilia Hernández, Diego Seco, Gonzalo Navarro 외

Signaling pathways are responsible for the regulation of cell processes, such as monitoring the external environment, transmitting information across membranes, and making cell fate decisions. Given the increasing amount…

InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models

2026-03-04 · Zhiqiang Sheng, Xumeng Han, Zhiwei Zhang, Zenghui Xiong 외 arxiv

Multimodal generative models have made significant strides in image editing, demonstrating impressive performance on a variety of static tasks. However, their proficiency typically does not extend to complex scenarios re…

Image Editing