Parameter estimation in softmax decision-making models with linear objective functions

2015-02-16 · Paul Reverdy, Naomi E. Leonard

With an eye towards human-centered automation, we contribute to the development of a systematic means to infer features of human decision-making from behavioral data. Motivated by the common use of softmax selection in models of human decision-making, we study the maximum likelihood parameter estimation problem for softmax decision-making models with linear objective functions. We present conditions under which the likelihood function is convex. These allow us to provide sufficient conditions for convergence of the resulting maximum likelihood estimator and to construct its asymptotic distribution. In the case of models with nonlinear objective functions, we show how the estimator can be applied by linearizing about a nominal parameter value. We apply the estimator to fit the stochastic UCL (Upper Credible Limit) model of human decision-making to human subject data. We show statistically significant differences in behavior across related, but distinct, tasks.

📄 PDF Abstract BibTeX arXiv:1502.04635

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Makingparameter estimation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Data-Free/Data-Sparse Softmax Parameter Estimation with Structured Class Geometries

2018-06-03 · Nisar Ahmed

This note considers softmax parameter estimation when little/no labeled training data is available, but a priori information about the relative geometry of class label log-odds boundaries is available. It is shown that `…

parameter estimation

Inference on Optimal Dynamic Policies via Softmax Approximation

2023-03-08 · Qizhao Chen, Morgane Austern, Vasilis Syrgkanis

Estimating optimal dynamic policies from offline data is a fundamental problem in dynamic decision making. In the context of causal inference, the problem is known as estimating the optimal dynamic treatment regime. Even…

Causal Inference Decision Making valid

Beyond Linear Attention: Softmax Transformers Implement In-Context Reinforcement Learning

2026-05-08 · Zixuan Xie, Xinyu Liu, Claire Chen, Shuze Daniel Liu 외 arxiv

In-context reinforcement learning (ICRL) studies agents that, after pretraining, adapt to new tasks by conditioning on additional context without parameter updates. Existing theoretical analyses of ICRL largely rely on l…

Reinforcement Learning

Neural Decision Trees

2017-02-23 · Randall Balestriero

In this paper we propose a synergistic melting of neural networks and decision trees (DT) we call neural decision trees (NDT). NDT is an architecture a la decision tree where each splitting node is an independent multila…

Clustering global-optimization

An Alternative Softmax Operator for Reinforcement Learning

2016-12-16 · ICML 2017 8 · Kavosh Asadi, Michael L. Littman

A softmax operator applied to a set of values acts somewhat like the maximization function and somewhat like an average. In sequential decision making, softmax is often used in settings where it is necessary to maximize …

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1