paper-with-me

홈 › Papers

HopCast: Calibration of Autoregressive Dynamics Models

2025-01-27 · Muhammad Bilal Shahid, Cody Fleming

Deep learning models are often trained to approximate dynamical systems that can be modeled using differential equations. These models are optimized to predict one step ahead and produce calibrated predictions if the predictive model can quantify uncertainty, such as deep ensembles. At inference time, multi-step predictions are generated via autoregression, which needs a sound uncertainty propagation method (e.g., Trajectory Sampling) to produce calibrated multi-step predictions. This paper introduces an approach named HopCast that uses the Modern Hopfield Network (MHN) to learn the residuals of a deterministic model that approximates the dynamical system. The MHN predicts the density of residuals based on a context vector at any timestep during autoregression. This approach produces calibrated multi-step predictions without uncertainty propagation and turns a deterministic model into a calibrated probabilistic model. This work is also the first to benchmark existing uncertainty propagation methods based on calibration errors with deep ensembles for multi-step predictions.

📄 PDF Abstract BibTeX arXiv:2501.16587

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Deep Ensembles 설명 없음

Similar Papers 제목 키워드 기반

Calibration window selection based on change-point detection for forecasting electricity prices

2022-04-02 · Julia Nasiadka, Weronika Nitka, Rafał Weron

We employ a recently proposed change-point detection algorithm, the Narrowest-Over-Threshold (NOT) method, to select subperiods of past observations that are similar to the currently recorded values. Then, contrarily to …

Change Point DetectionTime SeriesTime Series Analysis

Option Pricing with a Compound CARMA(p,q)-Hawkes

2024-12-19 · Lorenzo Mercuri, Andrea Perchiazzo, Edit Rroji

A self-exciting point process with a continuous-time autoregressive moving average intensity process, named CARMA(p,q)-Hawkes model, has recently been introduced. The model generalizes the Hawkes process by substituting …

Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamics

2021-05-17 · Vivek Jayaram, John Thickstun

This paper introduces an alternative approach to sampling from autoregressive models. Autoregressive models are typically sampled sequentially, according to the transition dynamics defined by the model. Instead, we propo…

Audio Source SeparationSuper-Resolution

Autoregressive Dynamics Models for Offline Policy Evaluation and Optimization

2021-04-28 · ICLR 2021 1 · Michael R. Zhang, Tom Le Paine, Ofir Nachum, Cosmin Paduraru 외

Standard dynamics models for continuous control make use of feedforward computation to predict the conditional distribution of next state and reward given current state and action using a multivariate Gaussian with a dia…

continuous-controlContinuous ControlData AugmentationMuJoCo+1

Mathematical Analysis of Hallucination Dynamics in Large Language Models: Uncertainty Quantification, Advanced Decoding, and Principled Mitigation

2025-11-19 · Moses Kiprono arxiv

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically gro…