paper-with-me

홈 › Papers

Inferring Inference

2023-10-04 · Rajkumar Vasudeva Raju, Zhe Li, Scott Linderman, Xaq Pitkow

Patterns of microcircuitry suggest that the brain has an array of repeated canonical computational units. Yet neural representations are distributed, so the relevant computations may only be related indirectly to single-neuron transformations. It thus remains an open challenge how to define canonical distributed computations. We integrate normative and algorithmic theories of neural computation into a mathematical framework for inferring canonical distributed computations from large-scale neural activity patterns. At the normative level, we hypothesize that the brain creates a structured internal model of its environment, positing latent causes that explain its sensory inputs, and uses those sensory inputs to infer the latent causes. At the algorithmic level, we propose that this inference process is a nonlinear message-passing algorithm on a graph-structured model of the world. Given a time series of neural activity during a perceptual inference task, our framework finds (i) the neural representation of relevant latent variables, (ii) interactions between these variables that define the brain's internal model of the world, and (iii) message-functions specifying the inference algorithm. These targeted computational properties are then statistically distinguishable due to the symmetries inherent in any canonical computation, up to a global transformation. As a demonstration, we simulate recordings for a model brain that implicitly implements an approximate inference algorithm on a probabilistic graphical model. Given its external inputs and noisy neural activity, we recover the latent variables, their neural representation and dynamics, and canonical message-functions. We highlight features of experimental design needed to successfully extract canonical computations from neural data. Overall, this framework provides a new tool for discovering interpretable structure in neural recordings.

📄 PDF Abstract BibTeX arXiv:2310.03186

Code (1)

xaqlab/inferringinference 공식 구현 pytorch

Tasks

Experimental Design

Similar Papers 제목 키워드 기반

Inferring Inferences: Relational Propositions for Argument Mining

2022-02-01 · SCiL 2022 2 · Andrew Potter
Argument Mining

Inferring dynamic regulatory interaction graphs from time series data with perturbations

2023-06-13 · Dhananjay Bhaskar, Sumner Magruder, Edward De Brouwer, Aarthi Venkat 외

Complex systems are characterized by intricate interactions between entities that evolve dynamically over time. Accurate inference of these dynamic relationships is crucial for understanding and predicting system behavio…

Causal InferenceGraph AttentionTime Series

Inferring biological processes with intrinsic noise from cross-sectional data

2024-10-10 · Suryanarayana Maddu, Victor Chardès, Michael. J. Shelley

Inferring dynamical models from data continues to be a significant challenge in computational biology, especially given the stochastic nature of many biological processes. We explore a common scenario in omics, where sta…

Inference, Prediction, and Entropy-Rate Estimation of Continuous-time, Discrete-event Processes

2020-05-07 · S. E. Marzen, J. P. Crutchfield

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-ti…

Interpretable Models for Granger Causality Using Self-explaining Neural Networks

2021-01-19 · ICLR 2021 1 · Ričards Marcinkevičs, Julia E. Vogt

Exploratory analysis of time series data can yield a better understanding of complex dynamical systems. Granger causality is a practical framework for analysing interactions in sequential data, applied in a wide range of…

Time SeriesTime Series Analysis