A Temporal Difference Reinforcement Learning Theory of Emotion: unifying emotion, cognition and adaptive behavior

2018-07-24 · Joost Broekens

Emotions are intimately tied to motivation and the adaptation of behavior, and many animal species show evidence of emotions in their behavior. Therefore, emotions must be related to powerful mechanisms that aid survival, and, emotions must be evolutionary continuous phenomena. How and why did emotions evolve in nature, how do events get emotionally appraised, how do emotions relate to cognitive complexity, and, how do they impact behavior and learning? In this article I propose that all emotions are manifestations of reward processing, in particular Temporal Difference (TD) error assessment. Reinforcement Learning (RL) is a powerful computational model for the learning of goal oriented tasks by exploration and feedback. Evidence indicates that RL-like processes exist in many animal species. Key in the processing of feedback in RL is the notion of TD error, the assessment of how much better or worse a situation just became, compared to what was previously expected (or, the estimated gain or loss of utility - or well-being - resulting from new evidence). I propose a TDRL Theory of Emotion and discuss its ramifications for our understanding of emotions in humans, animals and machines, and present psychological, neurobiological and computational evidence in its support.

📄 PDF Abstract BibTeX arXiv:1807.08941

Code (0)

등록된 구현이 없습니다.

Tasks

Learning TheoryReinforcement Learning Reinforcement Learning (RL)

A Tutorial Introduction to Reinforcement Learning

2023-04-03 · Mathukumalli Vidyasagar

In this paper, we present a brief survey of Reinforcement Learning (RL), with particular emphasis on Stochastic Approximation (SA) as a unifying theme. The scope of the paper includes Markov Reward Processes, Markov Deci…

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Double Q($σ$) and Q($σ, λ$): Unifying Reinforcement Learning Control Algorithms

2017-11-05 · Markus Dumke

Temporal-difference (TD) learning is an important field in reinforcement learning. Sarsa and Q-Learning are among the most used TD algorithms. The Q($\sigma$) algorithm (Sutton and Barto (2017)) unifies both. This paper …

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Proximal Reinforcement Learning: A New Theory of Sequential Decision Making in Primal-Dual Spaces

2014-05-26 · Sridhar Mahadevan, Bo Liu, Philip Thomas, Will Dabney 외

In this paper, we set forth a new vision of reinforcement learning developed by us over the past few years, one that yields mathematically rigorous solutions to longstanding important questions that have remained unresol…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+2

Why We Feel What We Feel: Joint Detection of Emotions and Their Opinion Triggers in E-commerce

2025-07-07 · Arnav Attri, Anuj Attri, Pushpak Bhattacharyya, Suman Banerjee 외 arxiv

Customer reviews on e-commerce platforms capture critical affective signals that drive purchasing decisions. However, no existing research has explored the joint task of emotion detection and explanatory span identificat…

Loss Dynamics of Temporal Difference Reinforcement Learning

2023-07-10 · NeurIPS 2023 11 · Blake Bordelon, Paul Masset, Henry Kuo, Cengiz Pehlevan

Reinforcement learning has been successful across several applications in which agents have to learn to act in environments with sparse feedback. However, despite this empirical success there is still a lack of theoretic…

reinforcement-learning Reinforcement Learning