paper-with-me

Papers

A Bayesian approach to quantifying uncertainties and improving generalizability in traffic prediction models

2023-07-12 · Agnimitra Sengupta, Sudeepta Mondal, Adway Das, S. Ilgin Guler

Deep-learning models for traffic data prediction can have superior performance in modeling complex functions using a multi-layer architecture. However, a major drawback of these approaches is that most of these approaches do not offer forecasts with uncertainty estimates, which are essential for traffic operations and control. Without uncertainty estimates, it is difficult to place any level of trust to the model predictions, and operational strategies relying on overconfident predictions can lead to worsening traffic conditions. In this study, we propose a Bayesian recurrent neural network framework for uncertainty quantification in traffic prediction with higher generalizability by introducing spectral normalization to its hidden layers. In our paper, we have shown that normalization alters the training process of deep neural networks by controlling the model's complexity and reducing the risk of overfitting to the training data. This, in turn, helps improve the generalization performance of the model on out-of-distribution datasets. Results demonstrate that spectral normalization improves uncertainty estimates and significantly outperforms both the layer normalization and model without normalization in single-step prediction horizons. This improved performance can be attributed to the ability of spectral normalization to better localize the feature space of the data under perturbations. Our findings are especially relevant to traffic management applications, where predicting traffic conditions across multiple locations is the goal, but the availability of training data from multiple locations is limited. Spectral normalization, therefore, provides a more generalizable approach that can effectively capture the underlying patterns in traffic data without requiring location-specific models.

📄 PDF Abstract BibTeX arXiv:2307.05946

Code (0)

등록된 구현이 없습니다.

Tasks

Traffic PredictionUncertainty Quantification

Methods 이 논문이 사용한 방법론

Spectral Normalization Spectral Normalization is a normalization technique used for generative adversarial networks, used to stabilize training of the discriminator. Spectral normalization has the…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

How Much Can I Trust You? -- Quantifying Uncertainties in Explaining Neural Networks

2020-06-16 · Kirill Bykov, Marina M. -C. Höhne, Klaus-Robert Müller, Shinichi Nakajima 외

Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the user and furthermore trustworthy also f…

Explainable Artificial Intelligence (XAI)

Bayesian Perceptron: Towards fully Bayesian Neural Networks

2020-09-03 · Marco F. Huber

Artificial neural networks (NNs) have become the de facto standard in machine learning. They allow learning highly nonlinear transformations in a plethora of applications. However, NNs usually only provide point estimate…

Bayesian Inference

A General Framework for quantifying Aleatoric and Epistemic uncertainty in Graph Neural Networks

2022-05-20 · Sai Munikoti, Deepesh Agarwal, Laya Das, Balasubramaniam Natarajan

Graph Neural Networks (GNN) provide a powerful framework that elegantly integrates Graph theory with Machine learning for modeling and analysis of networked data. We consider the problem of quantifying the uncertainty in…

Uncertainty-aware Attention Graph Neural Network for Defending Adversarial Attacks

2020-09-22 · Boyuan Feng, Yuke Wang, Zheng Wang, Yufei Ding

With the increasing popularity of graph-based learning, graph neural networks (GNNs) emerge as the essential tool for gaining insights from graphs. However, unlike the conventional CNNs that have been extensively explore…

Graph Neural Network

Unveiling the Power of Uncertainty: A Journey into Bayesian Neural Networks for Stellar dating

2025-03-27 · Víctor Tamames-Rodero, Andrés Moya, Roberto Javier López, Luis Manuel Sarro

Context: Astronomy and astrophysics demand rigorous handling of uncertainties to ensure the credibility of outcomes. The growing integration of artificial intelligence offers a novel avenue to address this necessity. Thi…

Astronomy