paper-with-me

홈 › Papers

A unified strategy for implementing curiosity and empowerment driven reinforcement learning

2018-06-18 · Ildefons Magrans de Abril, Ryota Kanai

Although there are many approaches to implement intrinsically motivated artificial agents, the combined usage of multiple intrinsic drives remains still a relatively unexplored research area. Specifically, we hypothesize that a mechanism capable of quantifying and controlling the evolution of the information flow between the agent and the environment could be the fundamental component for implementing a higher degree of autonomy into artificial intelligent agents. This paper propose a unified strategy for implementing two semantically orthogonal intrinsic motivations: curiosity and empowerment. Curiosity reward informs the agent about the relevance of a recent agent action, whereas empowerment is implemented as the opposite information flow from the agent to the environment that quantifies the agent's potential of controlling its own future. We show that an additional homeostatic drive is derived from the curiosity reward, which generalizes and enhances the information gain of a classical curious/heterostatic reinforcement learning agent. We show how a shared internal model by curiosity and empowerment facilitates a more efficient training of the empowerment function. Finally, we discuss future directions for further leveraging the interplay between these two intrinsic rewards.

📄 PDF Abstract BibTeX arXiv:1806.06505

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Universal AI maximizes Variational Empowerment

2025-02-20 · Yusuke Hayashi, Koichi Takahashi

This paper presents a theoretical framework unifying AIXI -- a model of universal AI -- with variational empowerment as an intrinsic drive for exploration. We build on the existing framework of Self-AIXI -- a universal l…

Towards Empowerment Gain through Causal Structure Learning in Model-Based RL

2025-02-14 · Hongye Cao, Fan Feng, Meng Fang, Shaokang Dong 외

In Model-Based Reinforcement Learning (MBRL), incorporating causal structures into dynamics models provides agents with a structured understanding of the environments, enabling efficient decision. Empowerment as an intri…

Causal DiscoveryModel-based Reinforcement Learning

An Empowerment-based Solution to Robotic Manipulation Tasks with Sparse Rewards

2020-10-15 · Siyu Dai, Wei Xu, Andreas Hofmann, Brian Williams

In order to provide adaptive and user-friendly solutions to robotic manipulation, it is important that the agent can learn to accomplish tasks even if they are only provided with very sparse instruction signals. To addre…

Diversityreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Artificial Agency Program: Curiosity, compression, and communication in agents

2026-02-27 · Richard Csaky arxiv

This paper presents the Artificial Agency Program (AAP), a position and research agenda for building AI systems as reality embedded, resource-bounded agents whose development is driven by curiosity-as-learning-progress u…

From Curiosity to Competence: How World Models Interact with the Dynamics of Exploration

2025-07-10 · Fryderyk Mantiuk, Hanqi Zhou, Charley M. Wu

What drives an agent to explore the world while also maintaining control over the environment? From a child at play to scientists in the lab, intelligent agents must balance curiosity (the drive to seek knowledge) with c…

reinforcement-learningReinforcement LearningRepresentation Learning