paper-with-me

홈 › Papers

Multi-Modal Graph Interaction for Multi-Graph Convolution Network in Urban Spatiotemporal Forecasting

2019-05-27 · Xu Geng, Xiyu Wu, Lingyu Zhang, Qiang Yang, Yan Liu, Jieping Ye

Graph convolution network based approaches have been recently used to model region-wise relationships in region-level prediction problems in urban computing. Each relationship represents a kind of spatial dependency, like region-wise distance or functional similarity. To incorporate multiple relationships into spatial feature extraction, we define the problem as a multi-modal machine learning problem on multi-graph convolution networks. Leveraging the advantage of multi-modal machine learning, we propose to develop modality interaction mechanisms for this problem, in order to reduce generalization error by reinforcing the learning of multimodal coordinated representations. In this work, we propose two interaction techniques for handling features in lower layers and higher layers respectively. In lower layers, we propose grouped GCN to combine the graph connectivity from different modalities for more complete spatial feature extraction. In higher layers, we adapt multi-linear relationship networks to GCN by exploring the dimension transformation and freezing part of the covariance structure. The adapted approach, called multi-linear relationship GCN, learns more generalized features to overcome the train-test divergence induced by time shifting. We evaluated our model on ridehailing demand forecasting problem using two real-world datasets. The proposed technique outperforms state-of-the art baselines in terms of prediction accuracy, training efficiency, interpretability and model robustness.

📄 PDF Abstract BibTeX arXiv:1905.11395

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningDemand Forecasting

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences

2020-10-22 · NAACL 2021 4 · Jianing Yang, Yongxin Wang, Ruitao Yi, Yuying Zhu 외

Human communication is multimodal in nature; it is through multiple modalities such as language, voice, and facial expressions, that opinions and emotions are expressed. Data in this domain exhibits complex multi-relatio…

Emotion RecognitionMultimodal Sentiment AnalysisSentiment Analysis

ReCoG: Reciprocal Co-Evolution for Multimodal Graph Learning

2026-08-24 · Rui Xue, Tianfu Wu arxiv

Multimodal graph learning requires jointly training over graph structure and heterogeneous node attributes, yet existing methods largely decouple these processes: prior multimodal graph neural networks (GNNs) focus on al…

Graph structure learningRepresentation LearningNode ClassificationLink Prediction

LoginMEA: Local-to-Global Interaction Network for Multi-modal Entity Alignment

2024-07-29 · Taoyu Su, Xinghua Zhang, Jiawei Sheng, Zhenyu Zhang 외

Multi-modal entity alignment (MMEA) aims to identify equivalent entities between two multi-modal knowledge graphs (MMKGs), whose entities can be associated with relational triples and related images. Most previous studie…

Entity AlignmentGraph AttentionKnowledge GraphsMulti-modal Entity Alignment

Modeling Polypharmacy and Predicting Drug-Drug Interactions using Deep Generative Models on Multimodal Graphs

2023-02-17 · Nhat Khang Ngo, Truong Son Hy, Risi Kondor

Latent representations of drugs and their targets produced by contemporary graph autoencoder models have proved useful in predicting many types of node-pair interactions on large networks, including drug-drug, drug-targe…

Link Prediction

Multimodal Fine-grained Context Interaction Graph Modeling for Conversational Speech Synthesis

2025-09-07 · Zhenqi Jia, Rui Liu, Berrak Sisman, Haizhou Li arxiv

Conversational Speech Synthesis (CSS) aims to generate speech with natural prosody by understanding the multimodal dialogue history (MDH). The latest work predicts the accurate prosody expression of the target utterance …

Speech Synthesis