paper-with-me

Papers

Privately Learning Markov Random Fields

2020-02-21 · ICML 2020 1 · Huanyu Zhang, Gautam Kamath, Janardhan Kulkarni, Zhiwei Steven Wu

We consider the problem of learning Markov Random Fields (including the prototypical example, the Ising model) under the constraint of differential privacy. Our learning goals include both structure learning, where we try to estimate the underlying graph structure of the model, as well as the harder goal of parameter learning, in which we additionally estimate the parameter on each edge. We provide algorithms and lower bounds for both problems under a variety of privacy constraints -- namely pure, concentrated, and approximate differential privacy. While non-privately, both learning goals enjoy roughly the same complexity, we show that this is not the case under differential privacy. In particular, only structure learning under approximate differential privacy maintains the non-private logarithmic dependence on the dimensionality of the data, while a change in either the learning goal or the privacy notion would necessitate a polynomial dependence. As a result, we show that the privacy constraint imposes a strong separation between these two learning problems in the high-dimensional data regime.

📄 PDF Abstract BibTeX arXiv:2002.09463

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Probabilistic Inference of Binary Markov Random Fields in Spiking Neural Networks through Mean-field Approximation

2019-02-22 · Yajing Zheng, Shanshan Jia, Zhaofei Yu, Tiejun Huang 외

Recent studies have suggested that the cognitive process of the human brain is realized as probabilistic inference and can be further modeled by probabilistic graphical models like Markov random fields. Nevertheless, it …

DenoisingImage Denoisingvalid

Tree-structured Markov random fields with Poisson marginal distributions

2024-08-24 · Benjamin Côté, Hélène Cossette, Etienne Marceau

A new family of tree-structured Markov random fields for a vector of discrete counting random variables is introduced. According to the characteristics of the family, the marginal distributions of the Markov random field…

Learning to Sample from Censored Markov Random Fields

2021-01-15 · Ankur Moitra, Elchanan Mossel, Colin Sandon

We study learning Censor Markov Random Fields (abbreviated CMRFs). These are Markov Random Fields where some of the nodes are censored (not observed). We present an algorithm for learning high-temperature CMRFs within o(…

Image Labeling with Markov Random Fields and Conditional Random Fields

2018-11-28 · Shangxuan Wu, Xinshuo Weng

Most existing methods for object segmentation in computer vision are formulated as a labeling task. This, in general, could be transferred to a pixel-wise label assignment task, which is quite similar to the structure of…

SegmentationSemantic Segmentation

Information Theoretic Properties of Markov Random Fields, and their Algorithmic Applications

2017-05-31 · NeurIPS 2017 12 · Linus Hamilton, Frederic Koehler, Ankur Moitra

Markov random fields area popular model for high-dimensional probability distributions. Over the years, many mathematical, statistical and algorithmic problems on them have been studied. Until recently, the only known al…