Optimizing sequential decisions in the drift-diffusion model
To make decisions organisms often accumulate information across multiple timescales. However, most experimental and modeling studies of decision-making focus on sequences of independent trials. On the other hand, natural environments are characterized by long temporal correlations, and evidence used to make a present choice is often relevant to future decisions. To understand decision-making under these conditions we analyze how a model ideal observer accumulates evidence to freely make choices across a sequence of correlated trials. We use principles of probabilistic inference to show that an ideal observer incorporates information obtained on one trial as an initial bias on the next. This bias decreases the time, but not the accuracy of the next decision. Furthermore, in finite sequences of trials the rate of reward is maximized when the observer deliberates longer for early decisions, but responds more quickly towards the end of the sequence. Our model also explains experimentally observed patterns in decision times and choices, thus providing a mathematically principled foundation for evidence-accumulation models of sequential decisions.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingmodelSimilar Papers 제목 키워드 기반
Speed, Quality, and the Optimal Timing of Complex Decisions: Field Evidence
This paper presents an empirical investigation of the relation between decision speed and decision quality for a real-world setting of cognitively-demanding decisions in which the timing of decisions is endogenous: profe…
Variable-Drift Diffusion Models of Pedestrian Road-Crossing Decisions
Human behavior and interaction in road traffic is highly complex, with many open scientific questions of high applied importance, not least in relation to recent development efforts toward automated vehicles. In parallel…
Decision MakingSequential $\delta$-optimal consumption and investment for stochastic volatility markets with unknown parameters
We consider an optimal investment and consumption problem for a Black-Scholes financial market with stochastic volatility and unknown stock appreciation rate. The volatility parameter is driven by an external economic fa…
Testing the Drift-Diffusion Model
The drift diffusion model (DDM) is a model of sequential sampling with diffusion (Brownian) signals, where the decision maker accumulates evidence until the process hits a stopping boundary, and then stops and chooses th…
modelExplicit moments of decision times for single- and double-threshold drift-diffusion processes
We derive expressions for the first three moments of the decision time (DT) distribution produced via first threshold crossings by sample paths of a drift-diffusion equation. The "pure" and "extended" diffusion processes…