paper-with-me

Papers

Adaptive Low-Complexity Sequential Inference for Dirichlet Process Mixture Models

2014-09-29 · NeurIPS 2015 12 · Theodoros Tsiligkaridis, Keith W. Forsythe

We develop a sequential low-complexity inference procedure for Dirichlet process mixtures of Gaussians for online clustering and parameter estimation when the number of clusters are unknown a-priori. We present an easily computable, closed form parametric expression for the conditional likelihood, in which hyperparameters are recursively updated as a function of the streaming data assuming conjugate priors. Motivated by large-sample asymptotics, we propose a novel adaptive low-complexity design for the Dirichlet process concentration parameter and show that the number of classes grow at most at a logarithmic rate. We further prove that in the large-sample limit, the conditional likelihood and data predictive distribution become asymptotically Gaussian. We demonstrate through experiments on synthetic and real data sets that our approach is superior to other online state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:1409.8185

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringOnline Clusteringparameter estimation

Similar Papers 제목 키워드 기반

Adaptive Scan Gibbs Sampler for Large Scale Inference Problems

2018-01-27 · Vadim Smolyakov, Qiang Liu, John W. Fisher III

For large scale on-line inference problems the update strategy is critical for performance. We derive an adaptive scan Gibbs sampler that optimizes the update frequency by selecting an optimum mini-batch size. We demonst…

Dynamic Hierarchical Dirichlet Process for Abnormal Behaviour Detection in Video

2016-06-27 · Olga Isupova, Danil Kuzin, Lyudmila Mihaylova

This paper proposes a novel dynamic Hierarchical Dirichlet Process topic model that considers the dependence between successive observations. Conventional posterior inference algorithms for this kind of models require pr…

Decision Making

Truncation-free Online Variational Inference for Bayesian Nonparametric Models

2012-12-01 · NeurIPS 2012 12 · Chong Wang, David M. Blei

We present a truncation-free online variational inference algorithm for Bayesian nonparametric models. Unlike traditional (online) variational inference algorithms that require truncations for the model or the variationa…

Topic ModelsVariational Inference

Stochastic Collapsed Variational Inference for Sequential Data

2015-12-05 · Pengyu Wang, Phil Blunsom

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm in the sequent…

Variational Inference

Neural Bayesian Sequential Routing

2026-05-22 · Yongchao Huang arxiv

Human decision-making is sequential and uncertainty-aware, yet standard neural networks often rely on static, dense forward computation with limited visibility into evidence acquisition, uncertainty evolution, or when co…

Medical Diagnosis