paper-with-me

Papers

Testing Ising Models

2016-12-09 · Constantinos Daskalakis, Nishanth Dikkala, Gautam Kamath

Given samples from an unknown multivariate distribution $p$, is it possible to distinguish whether $p$ is the product of its marginals versus $p$ being far from every product distribution? Similarly, is it possible to distinguish whether $p$ equals a given distribution $q$ versus $p$ and $q$ being far from each other? These problems of testing independence and goodness-of-fit have received enormous attention in statistics, information theory, and theoretical computer science, with sample-optimal algorithms known in several interesting regimes of parameters. Unfortunately, it has also been understood that these problems become intractable in large dimensions, necessitating exponential sample complexity. Motivated by the exponential lower bounds for general distributions as well as the ubiquity of Markov Random Fields (MRFs) in the modeling of high-dimensional distributions, we initiate the study of distribution testing on structured multivariate distributions, and in particular the prototypical example of MRFs: the Ising Model. We demonstrate that, in this structured setting, we can avoid the curse of dimensionality, obtaining sample and time efficient testers for independence and goodness-of-fit. One of the key technical challenges we face along the way is bounding the variance of functions of the Ising model.

📄 PDF Abstract BibTeX arXiv:1612.03147

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning and Testing Latent-Tree Ising Models Efficiently

2022-11-23 · Davin Choo, Yuval Dagan, Constantinos Daskalakis, Anthimos Vardis Kandiros

We provide time- and sample-efficient algorithms for learning and testing latent-tree Ising models, i.e. Ising models that may only be observed at their leaf nodes. On the learning side, we obtain efficient algorithms fo…

Property Testing in High Dimensional Ising models

2017-09-20 · Matey Neykov, Han Liu

This paper explores the information-theoretic limitations of graph property testing in zero-field Ising models. Instead of learning the entire graph structure, sometimes testing a basic graph property such as connectivit…

Vocal Bursts Intensity Prediction

Edge-preserving Image Denoising via Multi-scale Adaptive Statistical Independence Testing

2025-05-02 · Ruyu Yan, Da-qing Zhang

Edge detection is crucial in image processing, but existing methods often produce overly detailed edge maps, affecting clarity. Fixed-window statistical testing faces issues like scale mismatch and computational redundan…

DenoisingEdge DetectionImage Denoisingstatistical independence testing

Machine Learning Testing: Survey, Landscapes and Horizons

2019-06-19 · Jie M. Zhang, Mark Harman, Lei Ma, Yang Liu

This paper provides a comprehensive survey of Machine Learning Testing (ML testing) research. It covers 144 papers on testing properties (e.g., correctness, robustness, and fairness), testing components (e.g., the data, …

Autonomous DrivingBIG-bench Machine LearningFairnessMachine Translation+2

Limits on Testing Structural Changes in Ising Models

2020-12-01 · NeurIPS 2020 12 · Aditya Gangrade, Bobak Nazer, Venkatesh Saligrama

We present novel information-theoretic limits on detecting sparse changes in Isingmodels, a problem that arises in many applications where network changes canoccur due to some external stimuli. We show that the…

Change Detection