Goal-Directed Behavior under Variational Predictive Coding: Dynamic Organization of Visual Attention and Working Memory

2019-03-12 · Minju Jung, Takazumi Matsumoto, Jun Tani

Mental simulation is a critical cognitive function for goal-directed behavior because it is essential for assessing actions and their consequences. When a self-generated or externally specified goal is given, a sequence of actions that is most likely to attain that goal is selected among other candidates via mental simulation. Therefore, better mental simulation leads to better goal-directed action planning. However, developing a mental simulation model is challenging because it requires knowledge of self and the environment. The current paper studies how adequate goal-directed action plans of robots can be mentally generated by dynamically organizing top-down visual attention and visual working memory. For this purpose, we propose a neural network model based on variational Bayes predictive coding, where goal-directed action planning is formulated by Bayesian inference of latent intentional space. Our experimental results showed that cognitively meaningful competencies, such as autonomous top-down attention to the robot end effector (its hand) as well as dynamic organization of occlusion-free visual working memory, emerged. Furthermore, our analysis of comparative experiments indicated that introduction of visual working memory and the inference mechanism using variational Bayes predictive coding significantly improve the performance in planning adequate goal-directed actions.

📄 PDF Abstract BibTeX arXiv:1903.04932

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference

Habits and goals in synergy: a variational Bayesian framework for behavior

2023-04-11 · Dongqi Han, Kenji Doya, Dongsheng Li, Jun Tani

How to behave efficiently and flexibly is a central problem for understanding biological agents and creating intelligent embodied AI. It has been well known that behavior can be classified as two types: reward-maximizing…

Generating Goal-Directed Visuomotor Plans Based on Learning Using a Predictive Coding-type Deep Visuomotor Recurrent Neural Network Model

2018-03-07 · Minkyu Choi, Takazumi Matsumoto, Minju Jung, Jun Tani

The current paper presents how a predictive coding type deep recurrent neural networks can generate vision-based goal-directed plans based on prior learning experience by examining experiment results using a real arm rob…

Goal-Directed Planning by Reinforcement Learning and Active Inference

2021-06-18 · Dongqi Han, Kenji Doya, Jun Tani

What is the difference between goal-directed and habitual behavior? We propose a novel computational framework of decision making with Bayesian inference, in which everything is integrated as an entire neural network mod…

Bayesian Inference Decision Making reinforcement-learning Reinforcement Learning+1

Autonomous Identification and Goal-Directed Invocation of Event-Predictive Behavioral Primitives

2019-02-26 · Christian Gumbsch, Martin V. Butz, Georg Martius

Voluntary behavior of humans appears to be composed of small, elementary building blocks or behavioral primitives. While this modular organization seems crucial for the learning of complex motor skills and the flexible a…

Outcome-Driven Reinforcement Learning via Variational Inference

2021-04-20 · NeurIPS 2021 12 · Tim G. J. Rudner, Vitchyr H. Pong, Rowan Mcallister, Yarin Gal 외

While reinforcement learning algorithms provide automated acquisition of optimal policies, practical application of such methods requires a number of design decisions, such as manually designing reward functions that not…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Variational Inference