Conserved active information
We introduce conserved active information $I^\oplus$, a symmetric extension of active information that quantifies net information gain/loss across the entire search space, respecting No-Free-Lunch conservation. Through Bernoulli and uniform-baseline examples, we show $I^\oplus$ reveals regimes hidden from KL divergence, such as when strong knowledge reduces global disorder. Such regimes are proven formally under uniform baseline, distinguishing disorder (increasing mild knowledge from order-imposing strong knowledge. We further illustrate these regimes with examples from Markov chains and cosmological fine-tuning. This resolves a longstanding critique of active information while enabling applications in search, optimization, and beyond.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Characterisation of conserved and reacting moieties in chemical reaction networks
A detailed understanding of biochemical networks at the molecular level is essential for studying complex cellular processes. In this paper, we provide a comprehensive description of biochemical networks by considering i…
Learning Conserved Networks from Flows
A challenging problem in complex networks is the network reconstruction problem from data. This work deals with a class of networks denoted as conserved networks, in which a flow associated with every edge and the flows …
Discovering Conservation Laws using Optimal Transport and Manifold Learning
Conservation laws are key theoretical and practical tools for understanding, characterizing, and modeling nonlinear dynamical systems. However, for many complex systems, the corresponding conserved quantities are difficu…
Constants of Motion for Conserved and Non-conserved Dynamics
This paper begins with a dynamical model that was obtained by applying a machine learning technique (FJet) to time-series data; this dynamical model is then analyzed with Lie symmetry techniques to obtain constants of mo…
Time SeriesIdentification of conserved moieties in metabolic networks by graph theoretical analysis of atom transition networks
Conserved moieties are groups of atoms that remain intact in all reactions of a metabolic network. Identification of conserved moieties gives insight into the structure and function of metabolic networks and facilitates …
Network Identification