paper-with-me

홈 › Papers

Analyzing dynamic decision-making models using Chapman-Kolmogorov equations

2019-03-25

Decision-making in dynamic environments typically requires adaptive evidence accumulation that weights new evidence more heavily than old observations. Recent experimental studies of dynamic decision tasks require subjects to make decisions for which the correct choice switches stochastically throughout a single trial. In such cases, an ideal observer's belief is described by an evolution equation that is doubly stochastic, reflecting stochasticity in the both observations and environmental changes. In these contexts, we show that the probability density of the belief can be represented using differential Chapman-Kolmogorov equations, allowing efficient computation of ensemble statistics. This allows us to reliably compare normative models to near-normative approximations using, as model performance metrics, decision response accuracy and Kullback-Leibler divergence of the belief distributions. Such belief distributions could be obtained empirically from subjects by asking them to report their decision confidence. We also study how response accuracy is affected by additional internal noise, showing optimality requires longer integration timescales as more noise is added. Lastly, we demonstrate that our method can be applied to tasks in which evidence arrives in a discrete, pulsatile fashion, rather than continuously.

📄 PDF Abstract BibTeX arXiv:1903.10131

Code (1)

nwbarendregt/DynamicDecisionCKEquations 공식 구현

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Interpreting Quantum Learning Models via Stochastic Processes

2026-07-19 · Johannes Fankhauser, Lukas J. Fiderer, Hans J. Briegel arxiv

Quantum machine learning models define probabilistic input--output maps through coherent quantum evolution and measurement. While such models can exhibit computational advantages, their internal functioning and decision …

Quantum Machine LearningDecision Making

Data-Augmented Numerical Integration in State Prediction: Rule Selection

2024-12-09 · Jindrich Dunik, Ladislav Kral, Jakub Matousek, Ondrej Straka 외

This paper deals with the state prediction of nonlinear stochastic dynamic systems. The emphasis is laid on a solution to the integral Chapman-Kolmogorov equation by a deterministic-integration-rule-based point-mass meth…

Numerical IntegrationPrediction

A Unified Theory of Compositionality, Modularity, and Interpretability in Markov Decision Processes

2025-06-11 · Thomas J. Ringstrom, Paul R. Schrater

We introduce Option Kernel Bellman Equations (OKBEs) for a new reward-free Markov Decision Process. Rather than a value function, OKBEs directly construct and optimize a predictive map called a state-time option kernel (…

(In)stability in the Dynamics of the Cross-Country Distribution of Income Per Capita

2025-06-07 · Davide Fiaschi, Paul Johnson

Using a panel of 102 countries from PWT 10.0 covering 1970-2019, we examine the veracity of the assumption that a time-homogeneous, first-order process describes the evolution of the cross-country distribution of per cap…

Kolmogorov-Arnold Graph Neural Networks

2024-06-26 · Gianluca De Carlo, Andrea Mastropietro, Aris Anagnostopoulos

Graph neural networks (GNNs) excel in learning from network-like data but often lack interpretability, making their application challenging in domains requiring transparent decision-making. We propose the Graph Kolmogoro…

Decision MakingGraph ClassificationLink PredictionNode Classification