paper-with-me

Papers

Efficient Variational Bayes Learning of Graphical Models with Smooth Structural Changes

2020-09-16 · Hang Yu, Songwei Wu, Justin Dauwels

Estimating time-varying graphical models are of paramount importance in various social, financial, biological, and engineering systems, since the evolution of such networks can be utilized for example to spot trends, detect anomalies, predict vulnerability, and evaluate the impact of interventions. Existing methods require extensive tuning of parameters that control the graph sparsity and temporal smoothness. Furthermore, these methods are computationally burdensome with time complexity $O(NP^3)$ for $P$ variables and $N$ time points. As a remedy, we propose a low-complexity tuning-free Bayesian approach, named BASS. Specifically, we impose temporally-dependent spike-and-slab priors on the graphs such that they are sparse and varying smoothly across time. A variational inference algorithm is then derived to learn the graph structures from the data automatically. Owning to the pseudo-likelihood and the mean-field approximation, the time complexity of BASS is only $O(NP^2)$. Additionally, by identifying the frequency-domain resemblance to the time-varying graphical models, we show that BASS can be extended to learning frequency-varying inverse spectral density matrices, and yields graphical models for multivariate stationary time series. Numerical results on both synthetic and real data show that that BASS can better recover the underlying true graphs, while being more efficient than the existing methods, especially for high-dimensional cases.

📄 PDF Abstract BibTeX arXiv:2009.07703

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series AnalysisVariational Inference

Similar Papers 제목 키워드 기반

A derivation of variational message passing (VMP) for latent Dirichlet allocation (LDA)

2021-11-02 · Rebecca M. C. Taylor, Dirko Coetsee, Johan A. du Preez

Latent Dirichlet Allocation (LDA) is a probabilistic model used to uncover latent topics in a corpus of documents. Inference is often performed using variational Bayes (VB) algorithms, which calculate a lower bound to th…

Variational Inference

Bayesian Regularization for Functional Graphical Models with Applications to Neuroimaging

2021-10-11 · Jiajing Niu, Boyoung Hur, John Absher, D. Andrew Brown

Graphical models, used to express conditional dependence between random variables observed at various nodes, are used extensively in many fields such as genetics, neuroscience, and social network analysis. While most cur…

Coupled Variational Bayes via Optimization Embedding

2018-12-01 · NeurIPS 2018 12 · Bo Dai, Hanjun Dai, Niao He, Weiyang Liu 외

Variational inference plays a vital role in learning graphical models, especially on large-scale datasets. Much of its success depends on a proper choice of auxiliary distribution class for posterior approximation. Howev…

Variational Inference

Learning Structural Changes of Gaussian Graphical Models in Controlled Experiments

2012-03-15 · Bai Zhang, Yue Wang

Graphical models are widely used in scientific and engineering research to represent conditional independence structures between random variables. In many controlled experiments, environmental changes or external stimuli…

Partially Observable Online Change Detection via Smooth-Sparse Decomposition

2020-09-22 · Jie Guo, Hao Yan, Chen Zhang, Steven Hoi

We consider online change detection of high dimensional data streams with sparse changes, where only a subset of data streams can be observed at each sensing time point due to limited sensing capacities. On the one hand,…

Bayesian InferenceChange DetectionThompson Sampling