High-dimensional inference: a statistical mechanics perspective
Statistical inference is the science of drawing conclusions about some system from data. In modern signal processing and machine learning, inference is done in very high dimension: very many unknown characteristics about the system have to be deduced from a lot of high-dimensional noisy data. This "high-dimensional regime" is reminiscent of statistical mechanics, which aims at describing the macroscopic behavior of a complex system based on the knowledge of its microscopic interactions. It is by now clear that there are many connections between inference and statistical physics. This article aims at emphasizing some of the deep links connecting these apparently separated disciplines through the description of paradigmatic models of high-dimensional inference in the language of statistical mechanics. This article has been published in the issue on artificial intelligence of Ithaca, an Italian popularization-of-science journal. The selected topics and references are highly biased and not intended to be exhaustive in any ways. Its purpose is to serve as introduction to statistical mechanics of inference through a very specific angle that corresponds to my own tastes and limited knowledge.
Code (0)
등록된 구현이 없습니다.
Tasks
Vocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Statistical Mechanics of Dynamical System Identification
Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanics approach to analyze sparse equation discovery algorithms, which typically bala…
Bayesian InferenceEquation DiscoveryHyperparameter OptimizationUncertainty Quantification+1Statistical Mechanics and Artificial Neural Networks: Principles, Models, and Applications
The field of neuroscience and the development of artificial neural networks (ANNs) have mutually influenced each other, drawing from and contributing to many concepts initially developed in statistical mechanics. Notably…
Learning TheoryNon-equilibrium statistical physics, transitory epigenetic landscapes, and cell fate decision dynamics
Statistical physics provides a useful perspective for the analysis of many complex systems; it allows us to relate microscopic fluctuations to macroscopic observations. Developmental biology, but also cell biology more g…
Decision MakingGenerative AI for material design: A mechanics perspective from burgers to matter
Generative artificial intelligence offers a new paradigm to design matter in high-dimensional spaces. However, its underlying mechanisms remain difficult to interpret and limit adoption in computational mechanics. This g…
Explaining Machine Learning and Memorization with Statistical Mechanics
Artificial neural networks (NNs) and machine learning (ML) algorithms are poorly understood from a theoretical perspective, which makes it difficult to fully realize their potential and overcome their weaknesses. For ins…