paper-with-me

홈 › Papers

Bounded Rationality in Las Vegas: Probabilistic Finite Automata PlayMulti-Armed Bandits

2020-06-30 · Xinming Liu, Joseph Y. Halpern

While traditional economics assumes that humans are fully rational agents who always maximize their expected utility, in practice, we constantly observe apparently irrational behavior. One explanation is that people have limited computational power, so that they are, quite rationally, making the best decisions they can, given their computational limitations. To test this hypothesis, we consider the multi-armed bandit (MAB) problem. We examine a simple strategy for playing an MAB that can be implemented easily by a probabilistic finite automaton (PFA). Roughly speaking, the PFA sets certain expectations, and plays an arm as long as it meets them. If the PFA has sufficiently many states, it performs near-optimally. Its performance degrades gracefully as the number of states decreases. Moreover, the PFA acts in a "human-like" way, exhibiting a number of standard human biases, like an optimism bias and a negativity bias.

📄 PDF Abstract BibTeX arXiv:2006.16950

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Decidability of cutpoint isolation for probabilistic finite automata on letter-bounded inputs

2020-02-18 · Paul C. Bell, Pavel Semukhin

We show the surprising result that the cutpoint isolation problem is decidable for Probabilistic Finite Automata (PFA) where input words are taken from a letter-bounded context-free language. A context-free language $\ma…

Are Agents Probabilistic Automata? A Trace-Based, Memory-Constrained Theory of Agentic AI

2025-10-27 · Roham Koohestani, Ziyou Li, Anton Podkopaev, Maliheh Izadi arxiv

This paper studies standard controller architectures for agentic AI and derives automata-theoretic models of their interaction behavior via trace semantics and abstraction. We model an agent implementation as a finite co…

On the Derivational Entropy of Left-to-Right Probabilistic Finite-State Automata and Hidden Markov Models

2018-03-01 · CL 2018 3 · Joan Andreu S{\'a}nchez, Martha Alicia Rocha, Ver{\'o}nica Romero, Mauricio Villegas

Probabilistic finite-state automata are a formalism that is widely used in many problems of automatic speech recognition and natural language processing. Probabilistic finite-state automata are closely related to other f…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Generalized dynamic cognitive hierarchy models for strategic driving behavior

2021-09-20 · Atrisha Sarkar, Kate Larson, Krzysztof Czarnecki

While there has been an increasing focus on the use of game theoretic models for autonomous driving, empirical evidence shows that there are still open questions around dealing with the challenges of common knowledge ass…

Autonomous DrivingAutonomous Vehicles

Unambiguity and Fewness for Nonuniform Families of Polynomial-Size Nondeterministic Finite Automata

2023-11-16 · Tomoyuki Yamakami

Nonuniform families of polynomial-size finite automata, which are series of indexed finite automata having polynomially many inner states, are used in the past literature to solve nonuniform families of promise decision …