paper-with-me

홈 › Papers

Information thermodynamics: from physics to neuroscience

2024-09-26 · Jan Karbowski

This paper provides a perspective on applying the concepts of information thermodynamics, developed recently in non-equilibrium statistical physics, to problems in theoretical neuroscience. Historically, information and energy in neuroscience have been treated separately, in contrast to physics approaches, where the relationship of entropy production with heat is a central idea. It is argued here that also in neural systems information and energy can be considered within the same theoretical framework. Starting from basic ideas of thermodynamics and information theory on a classic Brownian particle, it is shown how noisy neural networks can infer its probabilistic motion. The decoding of the particle motion by neurons is performed with some accuracy and it has some energy cost, and both can be determined using information thermodynamics. In a similar fashion, we also discuss how neural networks in the brain can learn the particle velocity, and maintain that information in the weights of plastic synapses from a physical point of view. Generally, it is shown how the framework of stochastic and information thermodynamics can be used practically to study neural inference, learning, and information storing.

📄 PDF Abstract BibTeX arXiv:2409.17599

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Thermodynamics of learning physical phenomena

2022-07-26 · Elias Cueto, Francisco Chinesta

Thermodynamics could be seen as an expression of physics at a high epistemic level. As such, its potential as an inductive bias to help machine learning procedures attain accurate and credible predictions has been recent…

Inductive Bias

Port-metriplectic neural networks: thermodynamics-informed machine learning of complex physical systems

2022-11-03 · Quercus Hernández, Alberto Badías, Francisco Chinesta, Elías Cueto

We develop inductive biases for the machine learning of complex physical systems based on the port-Hamiltonian formalism. To satisfy by construction the principles of thermodynamics in the learned physics (conservation o…

Nonequilibrium thermodynamics of input-driven networks

2020-12-24 · Kevin S. Chen

Neural dynamics of energy-based models are governed by energy minimization and the patterns stored in the network are retrieved when the system reaches equilibrium. However, when the system is driven by time-varying exte…

Efficient coding with chaotic neural networks: A journey from neuroscience to physics and back

2024-08-04 · Jonathan Kadmon

This essay, derived from a lecture at "The Physics Modeling of Thought" workshop in Berlin in winter 2023, explores the mutually beneficial relationship between theoretical neuroscience and statistical physics through th…

Diffusion-Guided Renormalization of Neural Systems via Tensor Networks

2025-10-07 · Nathan X. Kodama arxiv

Far from equilibrium, neural systems self-organize across multiple scales. Exploiting multiscale self-organization in neuroscience and artificial intelligence requires a computational framework for modeling the effective…