paper-with-me

홈 › Papers

Scalable inference for crossed random effects models

2018-03-26 · Omiros Papaspiliopoulos, Gareth O. Roberts, Giacomo Zanella

We analyze the complexity of Gibbs samplers for inference in crossed random effect models used in modern analysis of variance. We demonstrate that for certain designs the plain vanilla Gibbs sampler is not scalable, in the sense that its complexity is worse than proportional to the number of parameters and data. We thus propose a simple modification leading to a collapsed Gibbs sampler that is provably scalable. Although our theory requires some balancedness assumptions on the data designs, we demonstrate in simulated and real datasets that the rates it predicts match remarkably the correct rates in cases where the assumptions are violated. We also show that the collapsed Gibbs sampler, extended to sample further unknown hyperparameters, outperforms significantly alternative state of the art algorithms.

📄 PDF Abstract BibTeX arXiv:1803.09460

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Scalable recommender system based on factor analysis

2024-08-12 · Disha Ghandwani, Trevor Hastie

Recommender systems have become crucial in the modern digital landscape, where personalized content, products, and services are essential for enhancing user experience. This paper explores statistical models for recommen…

parameter estimationRecommendation Systems

Streamlined Variational Inference for Linear Mixed Models with Crossed Random Effects

2019-10-04 · Marianne Menictas, Gioia Di Credico, Matt P. Wand

We derive streamlined mean field variational Bayes algorithms for fitting linear mixed models with crossed random effects. In the most general situation, where the dimensions of the crossed groups are arbitrarily large, …

Variational Inference

Scalable Computations for Generalized Mixed Effects Models with Crossed Random Effects Using Krylov Subspace Methods

2025-05-14 · Pascal Kündig, Fabio Sigrist

Mixed effects models are widely used for modeling data with hierarchically grouped structures and high-cardinality categorical predictor variables. However, for high-dimensional crossed random effects, current standard c…

subspace methods

Linear-cost unbiased posterior estimates for crossed effects and matrix factorization models via couplings

2024-10-11 · Paolo Maria Ceriani, Giacomo Zanella

We design and analyze unbiased Markov chain Monte Carlo (MCMC) schemes based on couplings of blocked Gibbs samplers (BGSs), whose total computational costs scale linearly with the number of parameters and data points. Ou…

Random-effects substitution models for phylogenetics via scalable gradient approximations

2023-03-23 · Andrew F. Magee, Andrew J. Holbrook, Jonathan E. Pekar, Itzue W. Caviedes-Solis 외

Phylogenetic and discrete-trait evolutionary inference depend heavily on an appropriate characterization of the underlying character substitution process. In this paper, we present random-effects substitution models that…

Bayesian Inference