Predictive Coding beyond Correlations
Recently, there has been extensive research on the capabilities of biologically plausible algorithms. In this work, we show how one of such algorithms, called predictive coding, is able to perform causal inference tasks. First, we show how a simple change in the inference process of predictive coding enables to compute interventions without the need to mutilate or redefine a causal graph. Then, we explore applications in cases where the graph is unknown, and has to be inferred from observational data. Empirically, we show how such findings can be used to improve the performance of predictive coding in image classification tasks, and conclude that such models are able to perform simple end-to-end causal inference tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceCausal DiscoveryCausal InferencecounterfactualCounterfactual Inferenceimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Beyond Marginal Uncertainty: How Accurately can Bayesian Regression Models Estimate Posterior Predictive Correlations?
While uncertainty estimation is a well-studied topic in deep learning, most such work focuses on marginal uncertainty estimates, i.e. the predictive mean and variance at individual input locations. But it is often more u…
Active LearningBenchmarkingregressionPredictive Coding: Towards a Future of Deep Learning beyond Backpropagation?
The backpropagation of error algorithm used to train deep neural networks has been fundamental to the successes of deep learning. However, it requires sequential backward updates and non-local computations, which make it…
Deep LearningNeural stochastic codes, encoding and decoding
Understanding brain function, constructing computational models and engineering neural prosthetics require assessing two problems, namely encoding and decoding, but their relation remains controversial. For decades, the …
Input nonlinearities can shape beyond-pairwise correlations and improve information transmission by neural populations
While recent recordings from neural populations show beyond-pairwise, or higher-order correlations (HOC), we have little understanding of how HOC arise from network interactions and of how they impact encoded information…
Inter-LPCM: Learning-based Inter-Frame Predictive Coding for LiDAR Point Cloud Compression
Because LiDAR sensors acquire point clouds with a fixed angular resolution, the resulting data can be systematically parameterized and efficiently compressed in the spherical coordinate system. Traditional spherical coor…
Point Clouds