paper-with-me

Papers

Expectation Propagation for t-Exponential Family Using Q-Algebra

2017-05-25 · NeurIPS 2017 12 · Futoshi Futami, Issei Sato, Masashi Sugiyama

Exponential family distributions are highly useful in machine learning since their calculation can be performed efficiently through natural parameters. The exponential family has recently been extended to the t-exponential family, which contains Student-t distributions as family members and thus allows us to handle noisy data well. However, since the t-exponential family is denied by the deformed exponential, we cannot derive an efficient learning algorithm for the t-exponential family such as expectation propagation (EP). In this paper, we borrow the mathematical tools of q-algebra from statistical physics and show that the pseudo additivity of distributions allows us to perform calculation of t-exponential family distributions through natural parameters. We then develop an expectation propagation (EP) algorithm for the t-exponential family, which provides a deterministic approximation to the posterior or predictive distribution with simple moment matching. We finally apply the proposed EP algorithm to the Bayes point machine and Student-t process classication, and demonstrate their performance numerically.

📄 PDF Abstract BibTeX arXiv:1705.09046

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Estimating the normal-inverse-Wishart distribution

2024-05-25 · Jonathan So

The normal-inverse-Wishart (NIW) distribution is commonly used as a prior distribution for the mean and covariance parameters of a multivariate normal distribution. The family of NIW distributions is also a minimal expon…

Expectation Particle Belief Propagation

2015-06-19 · NeurIPS 2015 12 · Thibaut Lienart, Yee Whye Teh, Arnaud Doucet

We propose an original particle-based implementation of the Loopy Belief Propagation (LPB) algorithm for pairwise Markov Random Fields (MRF) on a continuous state space. The algorithm constructs adaptively efficient prop…

Expectation Propagation for Continuous Time Bayesian Networks

2012-07-04 · Uri Nodelman, Daphne Koller, Christian R. Shelton

Continuous time Bayesian networks (CTBNs) describe structured stochastic processes with finitely many states that evolve over continuous time. A CTBN is a directed (possibly cyclic) dependency graph over a set of variabl…

Information Geometry of Message Passing

2026-08-16 · Mykola Lukashchuk, Kyrylo Yemets, Alex Ledbetter, İsmail Şenöz arxiv

We show that the natural-gradient stationary condition of variational inference has an edge-local form on a Forney-style factor graph. We start from the Bethe free energy and constrain a selected edge marginal to an expo…

Stein's Lemma for the Reparameterization Trick with Exponential Family Mixtures

2019-10-29 · Wu Lin, Mohammad Emtiyaz Khan, Mark Schmidt

Stein's method (Stein, 1973; 1981) is a powerful tool for statistical applications and has significantly impacted machine learning. Stein's lemma plays an essential role in Stein's method. Previous applications of Stein'…

LEMMA