paper-with-me

홈 › Papers

Neural Information Squeezer for Causal Emergence

2022-01-25 · Jiang Zhang, Kaiwei Liu

The classic studies of causal emergence have revealed that in some Markovian dynamical systems, far stronger causal connections can be found on the higher-level descriptions than the lower-level of the same systems if we coarse-grain the system states in an appropriate way. However, identifying this emergent causality from the data is still a hard problem that has not been solved because the correct coarse-graining strategy can not be found easily. This paper proposes a general machine learning framework called Neural Information Squeezer to automatically extract the effective coarse-graining strategy and the macro-state dynamics, as well as identify causal emergence directly from the time series data. By decomposing a coarse-graining operation into two processes: information conversion and information dropping out, we can not only exactly control the width of the information channel, but also can derive some important properties analytically including the exact expression of the effective information of a macro-dynamics. We also show how our framework can extract the dynamics on different levels and identify causal emergence from the data on several exampled systems.

📄 PDF Abstract BibTeX arXiv:2201.10154

Code (1)

jakezj/nis_for_causal_emergence 공식 구현 pytorch

Tasks

Time SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

PubSqueezer: A Text-Mining Web Tool to Transform Unstructured Documents into Structured Data

2020-11-05 · Alberto Calderone

The amount of scientific papers published every day is daunting and constantly increasing. Keeping up with literature represents a challenge. If one wants to start exploring new topics it is hard to have a big picture wi…

ArticlesSentence

Quantify the Causes of Causal Emergence: Critical Conditions of Uncertainty and Asymmetry in Causal Structure

2022-12-03 · Liye Jia, Fengyufan Yang, Ka Lok Man, Erick Purwanto 외

Beneficial to advanced computing devices, models with massive parameters are increasingly employed to extract more information to enhance the precision in describing and predicting the patterns of objective systems. This…

Emergence and Causality in Complex Systems: A Survey on Causal Emergence and Related Quantitative Studies

2023-12-28 · Bing Yuan, Zhang Jiang, Aobo Lyu, Jiayun Wu 외

Emergence and causality are two fundamental concepts for understanding complex systems. They are interconnected. On one hand, emergence refers to the phenomenon where macroscopic properties cannot be solely attributed to…

Model-based Reinforcement LearningRepresentation Learning

The Causally Emergent Alignment Hypothesis: Causal Emergence Aligns with and Predicts Final Reward in Reinforcement Learning Agents

2026-05-07 · Federico Pigozzi, Michael Levin arxiv

A hallmark of life on Earth is the ability of agents to exert causal power and be drivers of subsequent events. This is key to cognition at all scales. Causal emergence, measuring the degree to which an agent exerts uniq…

Reinforcement Learning

Greater than the parts: A review of the information decomposition approach to causal emergence

2021-11-12 · Pedro A. M. Mediano, Fernando E. Rosas, Andrea I. Luppi, Henrik J. Jensen 외

Emergence is a profound subject that straddles many scientific disciplines, including the formation of galaxies and how consciousness arises from the collective activity of neurons. Despite the broad interest that exists…