paper-with-me

홈 › Papers

Streamlined Variational Inference for Linear Mixed Models with Crossed Random Effects

2019-10-04 · Marianne Menictas, Gioia Di Credico, Matt P. Wand

We derive streamlined mean field variational Bayes algorithms for fitting linear mixed models with crossed random effects. In the most general situation, where the dimensions of the crossed groups are arbitrarily large, streamlining is hindered by lack of sparseness in the underlying least squares system. Because of this fact we also consider a hierarchy of relaxations of the mean field product restriction. The least stringent product restriction delivers a high degree of inferential accuracy. However, this accuracy must be mitigated against its higher storage and computing demands. Faster sparse storage and computing alternatives are also provided, but come with the price of diminished inferential accuracy. This article provides full algorithmic details of three variational inference strategies, presents detailed empirical results on their pros and cons and, thus, guides the users on their choice of variational inference approach depending on the problem size and computing resources.

📄 PDF Abstract BibTeX arXiv:1910.01799

Code (0)

등록된 구현이 없습니다.

Tasks

Variational Inference

Similar Papers 제목 키워드 기반

Partially factorized variational inference for high-dimensional mixed models

2023-12-20 · Max Goplerud, Omiros Papaspiliopoulos, Giacomo Zanella

While generalized linear mixed models are a fundamental tool in applied statistics, many specifications, such as those involving categorical factors with many levels or interaction terms, can be computationally challengi…

Uncertainty QuantificationVariational Inference

Ensemble Kalman Filtering Meets Gaussian Process SSM for Non-Mean-Field and Online Inference

2023-12-10 · Zhidi Lin, Yiyong Sun, Feng Yin, Alexandre Hoang Thiéry

The Gaussian process state-space models (GPSSMs) represent a versatile class of data-driven nonlinear dynamical system models. However, the presence of numerous latent variables in GPSSM incurs unresolved issues for exis…

State Space ModelsVariational Inference

Streamlined Empirical Bayes Fitting of Linear Mixed Models in Mobile Health

2020-03-28 · Marianne Menictas, Sabina Tomkins, Susan A. Murphy

To effect behavior change a successful algorithm must make high-quality decisions in real-time. For example, a mobile health (mHealth) application designed to increase physical activity must make contextually relevant su…

Reinforcement Learning

Latent mixed-effect models for high-dimensional longitudinal data

2024-09-17 · Priscilla Ong, Manuel Haußmann, Otto Lönnroth, Harri Lähdesmäki

Modelling longitudinal data is an important yet challenging task. These datasets can be high-dimensional, contain non-linear effects and time-varying covariates. Gaussian process (GP) prior-based variational autoencoders…

Time SeriesVariational Inference

Sockeye 2: A Toolkit for Neural Machine Translation

2020-11-01 · EAMT 2020 11 · Felix Hieber, Tobias Domhan, Michael Denkowski, David Vilar

We present Sockeye 2, a modernized and streamlined version of the Sockeye neural machine translation (NMT) toolkit. New features include a simplified code base through the use of MXNet’s Gluon API, a focus on state of th…

Machine TranslationNMTTranslation