paper-with-me

Papers

Algorithmic causal structure emerging through compression

2025-02-06 · Liang Wendong, Simon Buchholz, Bernhard Schölkopf

We explore the relationship between causality, symmetry, and compression. We build on and generalize the known connection between learning and compression to a setting where causal models are not identifiable. We propose a framework where causality emerges as a consequence of compressing data across multiple environments. We define algorithmic causality as an alternative definition of causality when traditional assumptions for causal identifiability do not hold. We demonstrate how algorithmic causal and symmetric structures can emerge from minimizing upper bounds on Kolmogorov complexity, without knowledge of intervention targets. We hypothesize that these insights may also provide a novel perspective on the emergence of causality in machine learning models, such as large language models, where causal relationships may not be explicitly identifiable.

📄 PDF Abstract BibTeX arXiv:2502.04210

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Binarized Neural Networks Converge Toward Algorithmic Simplicity: Empirical Support for the Learning-as-Compression Hypothesis

2025-05-27 · Eduardo Y. Sakabe, Felipe S. Abrahão, Alexandre Simões, Esther Colombini 외

Understanding and controlling the informational complexity of neural networks is a central challenge in machine learning, with implications for generalization, optimization, and model capacity. While most approaches rely…

A note on the complexity of the causal ordering problem

2015-08-24 · Bernardo Gonçalves, Fabio Porto

In this note we provide a concise report on the complexity of the causal ordering problem, originally introduced by Simon to reason about causal dependencies implicit in systems of mathematical equations. We show that Si…

Management

Real-Time Text Transmission via LLM-Based Entropy Coding over Fixed-Rate Channels

2026-05-03 · Vishnu Teja Kunde, Jean-Francois Chamberland, Krishna R. Narayanan, Jamison Ebert arxiv

Learning, prediction, and compression are intimately connected: a model that accurately predicts the next symbol in a sequence can be coupled with a source coder to compress that sequence near its information-theoretic l…

Quantum causal inference in the presence of hidden common causes: An entropic approach

2021-04-24 · Mohammad Ali Javidian, Vaneet Aggarwal, Zubin Jacob

Quantum causality is an emerging field of study which has the potential to greatly advance our understanding of quantum systems. In this paper, we put forth a theoretical framework for merging quantum information science…

Causal Inference

Granger Causal Structure Reconstruction from Heterogeneous Multivariate Time Series

2019-09-25 · Yunfei Chu, Xiaowei Wang, Chunyan Feng, Jianxin Ma 외

Granger causal structure reconstruction is an emerging topic that can uncover causal relationship behind multivariate time series data. In many real-world systems, it is common to encounter a large amount of multivariate…

Time SeriesTime Series Analysis