Spectral Modes of Network Dynamics Reveal Increased Informational Complexity Near Criticality
What does the informational complexity of dynamical networked systems tell us about intrinsic mechanisms and functions of these complex systems? Recent complexity measures such as integrated information have sought to operationalize this problem taking a whole-versus-parts perspective, wherein one explicitly computes the amount of information generated by a network as a whole over and above that generated by the sum of its parts during state transitions. While several numerical schemes for estimating network integrated information exist, it is instructive to pursue an analytic approach that computes integrated information as a function of network weights. Our formulation of integrated information uses a Kullback-Leibler divergence between the multi-variate distribution on the set of network states versus the corresponding factorized distribution over its parts. Implementing stochastic Gaussian dynamics, we perform computations for several prototypical network topologies. Our findings show increased informational complexity near criticality, which remains consistent across network topologies. Spectral decomposition of the system's dynamics reveals how informational complexity is governed by eigenmodes of both, the network's covariance and adjacency matrices. We find that as the dynamics of the system approach criticality, high integrated information is exclusively driven by the eigenmode corresponding to the leading eigenvalue of the covariance matrix, while sub-leading modes get suppressed. The implication of this result is that it might be favorable for complex dynamical networked systems such as the human brain or communication systems to operate near criticality so that efficient information integration might be achieved.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Spectral Edge Dynamics Reveal Functional Modes of Learning
Training dynamics during grokking concentrate along a small number of dominant update directions -- the spectral edge -- which reliably distinguishes grokking from non-grokking regimes. We show that standard mechanistic …
Path Integral Solution for Dissipative Generative Dynamics
Can purely mechanical systems generate intelligent language? We prove that dissipative quantum dynamics with analytically tractable non-local context aggregation produce coherent text generation, while conservation laws …
Text GenerationFirst-Order Geometry, Spectral Compression, and Structural Compatibility under Bounded Computation
Optimization under structural constraints is typically analyzed through projection or penalty methods, obscuring the geometric mechanism by which constraints shape admissible dynamics. We propose an operator-theoretic fo…
Rotated spectral principal component analysis (rsPCA) for identifying dynamical modes of variability in climate systems
Spectral PCA (sPCA), in contrast to classical PCA, offers the advantage of identifying organized spatio-temporal patterns within specific frequency bands and extracting dynamical modes. However, the unavoidable tradeoff …
DiagnosticTime Series AnalysisInformational Diversity and Affinity Bias in Team Growth Dynamics
Prior work has provided strong evidence that, within organizational settings, teams that bring a diversity of information and perspectives to a task are more effective than teams that do not. If this form of informationa…
Diversity