paper-with-me

Papers

Connecting the Dots: Numerical Randomized Hamiltonian Monte Carlo with State-Dependent Event Rates

2020-05-04 · Tore Selland Kleppe

Numerical Generalized Randomized Hamiltonian Monte Carlo is introduced, as a robust, easy to use and computationally fast alternative to conventional Markov chain Monte Carlo methods for continuous target distributions. A wide class of piecewise deterministic Markov processes generalizing Randomized HMC (Bou-Rabee and Sanz-Serna, 2017) by allowing for state-dependent event rates is defined. Under very mild restrictions, such processes will have the desired target distribution as an invariant distribution. Secondly, the numerical implementation of such processes, based on adaptive numerical integration of second order ordinary differential equations (ODEs) is considered. The numerical implementation yields an approximate, yet highly robust algorithm that, unlike conventional Hamiltonian Monte Carlo, enables the exploitation of the complete Hamiltonian trajectories (hence the title). The proposed algorithm may yield large speedups and improvements in stability relative to relevant benchmarks, while incurring numerical biases that are negligible relative to the overall Monte Carlo errors. Granted access to a high-quality ODE code, the proposed methodology is both easy to implement and use, even for highly challenging and high-dimensional target distributions.

📄 PDF Abstract BibTeX arXiv:2005.01285

Code (2)

torekleppe/PDPHMCpaperCode 공식 구현
torekleppe/pdphmc

Tasks

Numerical Integration

Similar Papers 제목 키워드 기반

Randomized Runge-Kutta-Nyström Methods for Unadjusted Hamiltonian and Kinetic Langevin Monte Carlo

2023-10-11 · Nawaf Bou-Rabee, Tore Selland Kleppe

We introduce $5/2$- and $7/2$-order $L^2$-accurate randomized Runge-Kutta-Nystr\"{o}m methods, tailored for approximating Hamiltonian flows within non-reversible Markov chain Monte Carlo samplers, such as unadjusted Hami…

Numerical Generalized Randomized Hamiltonian Monte Carlo for piecewise smooth target densities

2025-04-25 · Jimmy Huy Tran, Tore Selland Kleppe

Traditional gradient-based sampling methods, like standard Hamiltonian Monte Carlo, require that the desired target distribution is continuous and differentiable. This limits the types of models one can define, although …

Hamiltonian Descent Algorithms for Optimization: Accelerated Rates via Randomized Integration Time

2025-05-18 · Qiang Fu, Andre Wibisono

We study the Hamiltonian flow for optimization (HF-opt), which simulates the Hamiltonian dynamics for some integration time and resets the velocity to $0$ to decrease the objective function; this is the optimization anal…

On the Dissipation of Ideal Hamiltonian Monte Carlo Sampler

2022-09-15 · Qijia Jiang

We report on what seems to be an intriguing connection between variable integration time and partial velocity refreshment of Ideal Hamiltonian Monte Carlo samplers, both of which can be used for reducing the dissipative …

GIST: Gibbs self-tuning for locally adaptive Hamiltonian Monte Carlo

2024-04-23 · Nawaf Bou-Rabee, Bob Carpenter, Milo Marsden

We introduce a novel and flexible framework for constructing locally adaptive Hamiltonian Monte Carlo (HMC) samplers by Gibbs sampling the algorithm's tuning parameters conditionally based on the position and momentum at…

Position