paper-with-me

Papers

Stochastic Gradient Monomial Gamma Sampler

2017-06-05 · ICML 2017 8 · Yizhe Zhang, Changyou Chen, Zhe Gan, Ricardo Henao, Lawrence Carin

Recent advances in stochastic gradient techniques have made it possible to estimate posterior distributions from large datasets via Markov Chain Monte Carlo (MCMC). However, when the target posterior is multimodal, mixing performance is often poor. This results in inadequate exploration of the posterior distribution. A framework is proposed to improve the sampling efficiency of stochastic gradient MCMC, based on Hamiltonian Monte Carlo. A generalized kinetic function is leveraged, delivering superior stationary mixing, especially for multimodal distributions. Techniques are also discussed to overcome the practical issues introduced by this generalization. It is shown that the proposed approach is better at exploring complex multimodal posterior distributions, as demonstrated on multiple applications and in comparison with other stochastic gradient MCMC methods.

📄 PDF Abstract BibTeX arXiv:1706.01498

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Unifying Hamiltonian Monte Carlo and Slice Sampling

2016-02-25 · NeurIPS 2016 12 · Yizhe Zhang, Xiangyu Wang, Changyou Chen, Ricardo Henao 외

We unify slice sampling and Hamiltonian Monte Carlo (HMC) sampling, demonstrating their connection via the Hamiltonian-Jacobi equation from Hamiltonian mechanics. This insight enables extension of HMC and slice sampling …

Scaling up Dynamic Edge Partition Models via Stochastic Gradient MCMC

2024-02-29 · Sikun Yang, Heinz Koeppl

The edge partition model (EPM) is a generative model for extracting an overlapping community structure from static graph-structured data. In the EPM, the gamma process (GaP) prior is adopted to infer the appropriate numb…

Link Prediction

A Complete Recipe for Stochastic Gradient MCMC

2015-06-15 · NeurIPS 2015 12 · Yi-An Ma, Tianqi Chen, Emily B. Fox

Many recent Markov chain Monte Carlo (MCMC) samplers leverage continuous dynamics to define a transition kernel that efficiently explores a target distribution. In tandem, a focus has been on devising scalable variants t…

Physical Intuition

Exact Langevin Dynamics with Stochastic Gradients

2021-02-02 · pproximateinference AABI Symposium 2021 1 · Adrià Garriga-Alonso, Vincent Fortuin

Stochastic gradient Markov Chain Monte Carlo algorithms are popular samplers for approximate inference, but they are generally biased. We show that many recent versions of these methods (e.g. Chen et al. (2014)) cannot b…

Stochastic Continuous Submodular Maximization: Boosting via Non-oblivious Function

2022-01-03 · Qixin Zhang, Zengde Deng, Zaiyi Chen, Haoyuan Hu 외

In this paper, we revisit Stochastic Continuous Submodular Maximization in both offline and online settings, which can benefit wide applications in machine learning and operations research areas. We present a boosting fr…