paper-with-me

Papers

Structure Learning of Gaussian Markov Random Fields with False Discovery Rate Control

2019-10-24 · Sangkyun Lee, Piotr Sobczyk, Malgorzata Bogdan

In this paper, we propose a new estimation procedure for discovering the structure of Gaussian Markov random fields (MRFs) with false discovery rate (FDR) control, making use of the sorted l1-norm (SL1) regularization. A Gaussian MRF is an acyclic graph representing a multivariate Gaussian distribution, where nodes are random variables and edges represent the conditional dependence between the connected nodes. Since it is possible to learn the edge structure of Gaussian MRFs directly from data, Gaussian MRFs provide an excellent way to understand complex data by revealing the dependence structure among many inputs features, such as genes, sensors, users, documents, etc. In learning the graphical structure of Gaussian MRFs, it is desired to discover the actual edges of the underlying but unknown probabilistic graphical model-it becomes more complicated when the number of random variables (features) p increases, compared to the number of data points n. In particular, when p >> n, it is statistically unavoidable for any estimation procedure to include false edges. Therefore, there have been many trials to reduce the false detection of edges, in particular, using different types of regularization on the learning parameters. Our method makes use of the SL1 regularization, introduced recently for model selection in linear regression. We focus on the benefit of SL1 regularization that it can be used to control the FDR of detecting important random variables. Adapting SL1 for probabilistic graphical models, we show that SL1 can be used for the structure learning of Gaussian MRFs using our suggested procedure nsSLOPE (neighborhood selection Sorted L-One Penalized Estimation), controlling the FDR of detecting edges.

📄 PDF Abstract BibTeX arXiv:1910.10860

Code (0)

등록된 구현이 없습니다.

Tasks

Model Selection

Similar Papers 제목 키워드 기반

On the Kullback-Leibler divergence between pairwise isotropic Gaussian-Markov random fields

2022-03-24 · Alexandre L. M. Levada

The Kullback-Leibler divergence or relative entropy is an information-theoretic measure between statistical models that play an important role in measuring a distance between random variables. In the study of complex sys…

DenoisingImage DenoisingMetric Learning

Scalable Deep Gaussian Markov Random Fields for General Graphs

2022-06-10 · Joel Oskarsson, Per Sidén, Fredrik Lindsten

Machine learning methods on graphs have proven useful in many applications due to their ability to handle generally structured data. The framework of Gaussian Markov Random Fields (GMRFs) provides a principled way to def…

Bayesian InferenceVariational Inference

Deep Gaussian Markov Random Fields for Graph-Structured Dynamical Systems

2023-06-14 · NeurIPS 2023 11

Probabilistic inference in high-dimensional state-space models is computationally challenging. For many spatiotemporal systems, however, prior knowledge about the dependency structure of state variables is available. We …

State EstimationState Space ModelsVariational Inference

Deep Gaussian Markov Random Fields

2020-02-18 · ICML 2020 1 · Per Sidén, Fredrik Lindsten

Gaussian Markov random fields (GMRFs) are probabilistic graphical models widely used in spatial statistics and related fields to model dependencies over spatial structures. We establish a formal connection between GMRFs …

Variational Inference

Lower Bounds for Two-Sample Structural Change Detection in Ising and Gaussian Models

2017-10-28 · Aditya Gangrade, Bobak Nazer, Venkatesh Saligrama

The change detection problem is to determine if the Markov network structures of two Markov random fields differ from one another given two sets of samples drawn from the respective underlying distributions. We study the…

Change Detection