paper-with-me

홈 › Papers

On the Efficient Marginalization of Probabilistic Sequence Models

2024-03-06 · Alex Boyd

Real-world data often exhibits sequential dependence, across diverse domains such as human behavior, medicine, finance, and climate modeling. Probabilistic methods capture the inherent uncertainty associated with prediction in these contexts, with autoregressive models being especially prominent. This dissertation focuses on using autoregressive models to answer complex probabilistic queries that go beyond single-step prediction, such as the timing of future events or the likelihood of a specific event occurring before another. In particular, we develop a broad class of novel and efficient approximation techniques for marginalization in sequential models that are model-agnostic. These techniques rely solely on access to and sampling from next-step conditional distributions of a pre-trained autoregressive model, including both traditional parametric models as well as more recent neural autoregressive models. Specific approaches are presented for discrete sequential models, for marked temporal point processes, and for stochastic jump processes, each tailored to a well-defined class of informative, long-range probabilistic queries.

📄 PDF Abstract BibTeX arXiv:2403.04005

Code (0)

등록된 구현이 없습니다.

Tasks

Point Processes

Similar Papers 제목 키워드 기반

The Limits of Tractable Marginalization

2025-04-17 · Oliver Broadrick, Sanyam Agarwal, Guy Van Den Broeck, Markus Bläser

Marginalization -- summing a function over all assignments to a subset of its inputs -- is a fundamental computational problem with applications from probabilistic inference to formal verification. Despite its computatio…

On Probabilistic and Causal Reasoning with Summation Operators

2024-05-05 · Duligur Ibeling, Thomas F. Icard, Milan Mossé

Ibeling et al. (2023). axiomatize increasingly expressive languages of causation and probability, and Mosse et al. (2024) show that reasoning (specifically the satisfiability problem) in each causal language is as diffic…

Causal Inference

Marginalization Consistent Probabilistic Forecasting of Irregular Time Series via Mixture of Separable flows

2024-06-11 · Vijaya Krishna Yalavarthi, Randolf Scholz, Christian Kloetergens, Kiran Madhusudhanan 외

Probabilistic forecasting models for joint distributions of targets in irregular time series with missing values are a heavily under-researched area in machine learning, with, to the best of our knowledge, only two Model…

Gaussian ProcessesGPRIrregular Time SeriesMissing Values+2

Automatically Marginalized MCMC in Probabilistic Programming

2023-02-01 · Jinlin Lai, Javier Burroni, Hui Guan, Daniel Sheldon

Hamiltonian Monte Carlo (HMC) is a powerful algorithm to sample latent variables from Bayesian models. The advent of probabilistic programming languages (PPLs) frees users from writing inference algorithms and lets users…

Probabilistic Programming

Inference by Reparameterization in Neural Population Codes

2016-05-20 · NeurIPS 2016 12

Behavioral experiments on humans and animals suggest that the brain performs probabilistic inference to interpret its environment. Here we present a new general-purpose, biologically-plausible neural implementation of ap…