paper-with-me

홈 › Papers

Computationally sufficient statistics for Ising models

2026-02-12 · Abhijith Jayakumar, Shreya Shukla, Marc Vuffray, Andrey Y. Lokhov, Sidhant Misra arxiv

Learning Gibbs distributions using only sufficient statistics has long been recognized as a computationally hard problem. On the other hand, computationally efficient algorithms for learning Gibbs distributions rely on access to full sample configurations generated from the model. For many systems of interest that arise in physical contexts, expecting a full sample to be observed is not practical, and hence it is important to look for computationally efficient methods that solve the learning problem with access to only a limited set of statistics. We examine the trade-offs between the power of computation and observation within this scenario, employing the Ising model as a paradigmatic example. We demonstrate that it is feasible to reconstruct the model parameters for a model with $\ell_1$ width $γ$ by observing statistics up to an order of $O(γ)$. This approach allows us to infer the model's structure and also learn its couplings and magnetic fields. We also discuss a setting where prior information about structure of the model is available and show that the learning problem can be solved efficiently with even more limited observational power.

📄 PDF Abstract BibTeX arXiv:2602.12449

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Computational Implications of Reducing Data to Sufficient Statistics

2014-09-12 · Andrea Montanari

Given a large dataset and an estimation task, it is common to pre-process the data by reducing them to a set of sufficient statistics. This step is often regarded as straightforward and advantageous (in that it simplifie…

Learning Summary Statistic for Approximate Bayesian Computation via Deep Neural Network

2015-10-08 · Bai Jiang, Tung-Yu Wu, Charles Zheng, Wing H. Wong

Approximate Bayesian Computation (ABC) methods are used to approximate posterior distributions in models with unknown or computationally intractable likelihoods. Both the accuracy and computational efficiency of ABC depe…

Computational Efficiency

Mode Estimation with Partial Feedback

2024-02-20 · Charles Arnal, Vivien Cabannes, Vianney Perchet

The combination of lightly supervised pre-training and online fine-tuning has played a key role in recent AI developments. These new learning pipelines call for new theoretical frameworks. In this paper, we formalize cor…

Active Learning

Causal learning with sufficient statistics: an information bottleneck approach

2020-10-12 · Daniel Chicharro, Michel Besserve, Stefano Panzeri

The inference of causal relationships using observational data from partially observed multivariate systems with hidden variables is a fundamental question in many scientific domains. Methods extracting causal informatio…

Dimensionality Reduction

Private Regression via Data-Dependent Sufficient Statistic Perturbation

2024-05-23 · Cecilia Ferrando, Daniel Sheldon

Sufficient statistic perturbation (SSP) is a widely used method for differentially private linear regression. SSP adopts a data-independent approach where privacy noise from a simple distribution is added to sufficient s…

regression