paper-with-me

홈 › Papers

Incorporating Domain Differential Equations into Graph Convolutional Networks to Lower Generalization Discrepancy

2024-04-01 · Yue Sun, Chao Chen, Yuesheng Xu, Sihong Xie, Rick S. Blum, Parv Venkitasubramaniam

Ensuring both accuracy and robustness in time series prediction is critical to many applications, ranging from urban planning to pandemic management. With sufficient training data where all spatiotemporal patterns are well-represented, existing deep-learning models can make reasonably accurate predictions. However, existing methods fail when the training data are drawn from different circumstances (e.g., traffic patterns on regular days) compared to test data (e.g., traffic patterns after a natural disaster). Such challenges are usually classified under domain generalization. In this work, we show that one way to address this challenge in the context of spatiotemporal prediction is by incorporating domain differential equations into Graph Convolutional Networks (GCNs). We theoretically derive conditions where GCNs incorporating such domain differential equations are robust to mismatched training and testing data compared to baseline domain agnostic models. To support our theory, we propose two domain-differential-equation-informed networks called Reaction-Diffusion Graph Convolutional Network (RDGCN), which incorporates differential equations for traffic speed evolution, and Susceptible-Infectious-Recovered Graph Convolutional Network (SIRGCN), which incorporates a disease propagation model. Both RDGCN and SIRGCN are based on reliable and interpretable domain differential equations that allow the models to generalize to unseen patterns. We experimentally show that RDGCN and SIRGCN are more robust with mismatched testing data than the state-of-the-art deep learning methods.

📄 PDF Abstract BibTeX arXiv:2404.01217

Code (0)

등록된 구현이 없습니다.

Tasks

Domain GeneralizationTime Series Prediction

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Graph Neural Ordinary Differential Equations

2019-11-18 · Michael Poli, Stefano Massaroli, Junyoung Park, Atsushi Yamashita 외

We introduce the framework of continuous--depth graph neural networks (GNNs). Graph neural ordinary differential equations (GDEs) are formalized as the counterpart to GNNs where the input-output relationship is determine…

FinNet: Solving Time-Independent Differential Equations with Finite Difference Neural Network

2022-02-18 · Son N. T. Tu, Thu Nguyen

Deep learning approaches for partial differential equations (PDEs) have received much attention in recent years due to their mesh-freeness and computational efficiency. However, most of the works so far have concentrated…

Computational EfficiencyDeep Learning

Discovering Ordinary Differential Equations with LLM-Based Qualitative and Quantitative Evaluation

2026-05-08 · Sum Kyun Song, Bong Gyun Shin, Jae Yong Lee arxiv

Discovering governing differential equations from observational data is a fundamental challenge in scientific machine learning. Existing symbolic regression approaches rely primarily on quantitative metrics; however, rea…

GCN-FFNN: A Two-Stream Deep Model for Learning Solution to Partial Differential Equations

2022-04-28 · Onur Bilgin, Thomas Vergutz, Siamak Mehrkanoon

This paper introduces a novel two-stream deep model based on graph convolutional network (GCN) architecture and feed-forward neural networks (FFNN) for learning the solution of nonlinear partial differential equations (P…

Improved underwater image enhancement algorithms based on partial differential equations (PDEs)

2017-04-29 · U. A. Nnolim

The experimental results of improved underwater image enhancement algorithms based on partial differential equations (PDEs) are presented in this report. This second work extends the study of previous work and incorporat…

Image Enhancement