paper-with-me

홈 › Papers

diffIRM: A Diffusion-Augmented Invariant Risk Minimization Framework for Spatiotemporal Prediction over Graphs

2024-12-31 · Zhaobin Mo, Haotian Xiang, Xuan Di

Spatiotemporal prediction over graphs (STPG) is challenging, because real-world data suffers from the Out-of-Distribution (OOD) generalization problem, where test data follow different distributions from training ones. To address this issue, Invariant Risk Minimization (IRM) has emerged as a promising approach for learning invariant representations across different environments. However, IRM and its variants are originally designed for Euclidean data like images, and may not generalize well to graph-structure data such as spatiotemporal graphs due to spatial correlations in graphs. To overcome the challenge posed by graph-structure data, the existing graph OOD methods adhere to the principles of invariance existence, or environment diversity. However, there is little research that combines both principles in the STPG problem. A combination of the two is crucial for efficiently distinguishing between invariant features and spurious ones. In this study, we fill in this research gap and propose a diffusion-augmented invariant risk minimization (diffIRM) framework that combines these two principles for the STPG problem. Our diffIRM contains two processes: i) data augmentation and ii) invariant learning. In the data augmentation process, a causal mask generator identifies causal features and a graph-based diffusion model acts as an environment augmentor to generate augmented spatiotemporal graph data. In the invariant learning process, an invariance penalty is designed using the augmented data, and then serves as a regularizer for training the spatiotemporal prediction model. The real-world experiment uses three human mobility datasets, i.e. SafeGraph, PeMS04, and PeMS08. Our proposed diffIRM outperforms baselines.

📄 PDF Abstract BibTeX arXiv:2501.00305

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Continual Invariant Risk Minimization

2023-10-21 · Francesco Alesiani, Shujian Yu, Mathias Niepert

Empirical risk minimization can lead to poor generalization behavior on unseen environments if the learned model does not capture invariant feature representations. Invariant risk minimization (IRM) is a recent proposal …

Continual Learning

Kernelized Heterogeneous Risk Minimization

2021-10-24 · Jiashuo Liu, Zheyuan Hu, Peng Cui, Bo Li 외

The ability to generalize under distributional shifts is essential to reliable machine learning, while models optimized with empirical risk minimization usually fail on non-$i.i.d$ testing data. Recently, invariant learn…

The Risks and Rewards of Invariant Risk Minimization

2022-01-17 · ICLR Track Blog 2022 5 · Anonymous

Spurious correlations are one of the most prominent pain points for building and deploying machine learning models. Invariant Risk Minimization (IRM) is a learning algorithm designed to mitigate the effect of spurious fe…

BIG-bench Machine Learning

Robustness through Data Augmentation Loss Consistency

2021-10-21 · Tianjian Huang, Shaunak Halbe, Chinnadhurai Sankar, Pooyan Amini 외

While deep learning through empirical risk minimization (ERM) has succeeded at achieving human-level performance at a variety of complex tasks, ERM is not robust to distribution shifts or adversarial attacks. Synthetic d…

Multi-domain Dialogue State TrackingVisual Question AnsweringVisual Question Answering (VQA)

Invariant Risk Minimization

2019-07-05 · Martin Arjovsky, Léon Bottou, Ishaan Gulrajani, David Lopez-Paz

We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant correlations across multiple training distributions. To achieve this goal, IRM learns a data representation such that the optimal …

Domain GeneralizationImage ClassificationOut-of-Distribution Generalization