Analyzing dynamic decision-making models using Chapman-Kolmogorov equations
Decision-making in dynamic environments typically requires adaptive evidence accumulation that weights new evidence more heavily than old observations. Recent experimental studies of dynamic decision tasks require subjects to make decisions for which the correct choice switches stochastically throughout a single trial. In such cases, an ideal observer's belief is described by an evolution equation that is doubly stochastic, reflecting stochasticity in the both observations and environmental changes. In these contexts, we show that the probability density of the belief can be represented using differential Chapman-Kolmogorov equations, allowing efficient computation of ensemble statistics. This allows us to reliably compare normative models to near-normative approximations using, as model performance metrics, decision response accuracy and Kullback-Leibler divergence of the belief distributions. Such belief distributions could be obtained empirically from subjects by asking them to report their decision confidence. We also study how response accuracy is affected by additional internal noise, showing optimality requires longer integration timescales as more noise is added. Lastly, we demonstrate that our method can be applied to tasks in which evidence arrives in a discrete, pulsatile fashion, rather than continuously.
Code (1)
Tasks
Decision MakingSimilar Papers 제목 키워드 기반
Interpreting Quantum Learning Models via Stochastic Processes
Quantum machine learning models define probabilistic input--output maps through coherent quantum evolution and measurement. While such models can exhibit computational advantages, their internal functioning and decision …
Quantum Machine LearningDecision MakingData-Augmented Numerical Integration in State Prediction: Rule Selection
This paper deals with the state prediction of nonlinear stochastic dynamic systems. The emphasis is laid on a solution to the integral Chapman-Kolmogorov equation by a deterministic-integration-rule-based point-mass meth…
Numerical IntegrationPredictionA Unified Theory of Compositionality, Modularity, and Interpretability in Markov Decision Processes
We introduce Option Kernel Bellman Equations (OKBEs) for a new reward-free Markov Decision Process. Rather than a value function, OKBEs directly construct and optimize a predictive map called a state-time option kernel (…
(In)stability in the Dynamics of the Cross-Country Distribution of Income Per Capita
Using a panel of 102 countries from PWT 10.0 covering 1970-2019, we examine the veracity of the assumption that a time-homogeneous, first-order process describes the evolution of the cross-country distribution of per cap…
Kolmogorov-Arnold Graph Neural Networks
Graph neural networks (GNNs) excel in learning from network-like data but often lack interpretability, making their application challenging in domains requiring transparent decision-making. We propose the Graph Kolmogoro…
Decision MakingGraph ClassificationLink PredictionNode Classification