Hierarchical Affordance Discovery using Intrinsic Motivation

2020-09-23 · Alexandre Manoury, Sao Mai Nguyen, Cédric Buche

To be capable of lifelong learning in a real-life environment, robots have to tackle multiple challenges. Being able to relate physical properties they may observe in their environment to possible interactions they may have is one of them. This skill, named affordance learning, is strongly related to embodiment and is mastered through each person's development: each individual learns affordances differently through their own interactions with their surroundings. Current methods for affordance learning usually use either fixed actions to learn these affordances or focus on static setups involving a robotic arm to be operated. In this article, we propose an algorithm using intrinsic motivation to guide the learning of affordances for a mobile robot. This algorithm is capable to autonomously discover, learn and adapt interrelated affordances without pre-programmed actions. Once learned, these affordances may be used by the algorithm to plan sequences of actions in order to perform tasks of various difficulties. We then present one experiment and analyse our system before comparing it with other approaches from reinforcement learning and affordance learning.

📄 PDF Abstract BibTeX arXiv:2009.10968

Code (0)

등록된 구현이 없습니다.

Tasks

Lifelong learning

Efficient Exploration through Intrinsic Motivation Learning for Unsupervised Subgoal Discovery in Model-Free Hierarchical Reinforcement Learning

2019-11-18 · Jacob Rafati, David C. Noelle

Efficient exploration for automatic subgoal discovery is a challenging problem in Hierarchical Reinforcement Learning (HRL). In this paper, we show that intrinsic motivation learning increases the efficiency of explorati…

Efficient Exploration Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Constrained Intrinsic Motivation for Reinforcement Learning

2024-07-12 · Xiang Zheng, Xingjun Ma, Chao Shen, Cong Wang

This paper investigates two fundamental problems that arise when utilizing Intrinsic Motivation (IM) for reinforcement learning in Reward-Free Pre-Training (RFPT) tasks and Exploration with Intrinsic Motivation (EIM) tas…

MuJoCo reinforcement-learning Reinforcement Learning

Learning Representations in Model-Free Hierarchical Reinforcement Learning

2018-10-23 · Jacob Rafati, David C. Noelle

Common approaches to Reinforcement Learning (RL) are seriously challenged by large-scale applications involving huge state spaces and sparse delayed reward feedback. Hierarchical Reinforcement Learning (HRL) methods atte…

Hierarchical Reinforcement Learning model Montezuma's Revenge reinforcement-learning+2

Meta-Learning Integration in Hierarchical Reinforcement Learning for Advanced Task Complexity

2024-10-10 · Arash Khajooeinejad, Masoumeh Chapariniya

Hierarchical Reinforcement Learning (HRL) effectively tackles complex tasks by decomposing them into structured policies. However, HRL agents often face challenges with efficient exploration and rapid adaptation. To addr…

Efficient Exploration Hierarchical Reinforcement Learning Meta-Learning

Beyond Binary: Reframing GUI Critique as Continuous Semantic Alignment

2026-05-14 · Yuchen Sun, Pei Fu, Shaojie Zhang, Anan Du 외 arxiv

Test-Time Scaling (TTS), which samples multiple candidate actions and ranks them via a Critic Model, has emerged as a promising paradigm for generalist GUI agents. Its efficacy thus hinges on the critic's fine-grained ra…

Binary Classification Contrastive Learning