paper-with-me

Papers

Prototyping three key properties of specific curiosity in computational reinforcement learning

2022-05-20 · Nadia M. Ady, Roshan Shariff, Johannes Günther, Patrick M. Pilarski

Curiosity for machine agents has been a focus of intense research. The study of human and animal curiosity, particularly specific curiosity, has unearthed several properties that would offer important benefits for machine learners, but that have not yet been well-explored in machine intelligence. In this work, we introduce three of the most immediate of these properties -- directedness, cessation when satisfied, and voluntary exposure -- and show how they may be implemented together in a proof-of-concept reinforcement learning agent; further, we demonstrate how the properties manifest in the behaviour of this agent in a simple non-episodic grid-world environment that includes curiosity-inducing locations and induced targets of curiosity. As we would hope, the agent exhibits short-term directed behaviour while updating long-term preferences to adaptively seek out curiosity-inducing situations. This work therefore presents a novel view into how specific curiosity operates and in the future might be integrated into the behaviour of goal-seeking, decision-making agents in complex environments.

📄 PDF Abstract BibTeX arXiv:2205.10407

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Makingreinforcement-learningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Five Properties of Specific Curiosity You Didn't Know Curious Machines Should Have

2022-12-01 · Nadia M. Ady, Roshan Shariff, Johannes Günther, Patrick M. Pilarski

Curiosity for machine agents has been a focus of lively research activity. The study of human and animal curiosity, particularly specific curiosity, has unearthed several properties that would offer important benefits fo…

Decision Makingreinforcement-learningReinforcement Learning (RL)

What killed the cat? Towards a logical formalization of curiosity (and suspense, and surprise) in narratives

2024-10-11 · Florence Dupin de Saint-Cyr, Anne-Gwenn Bosser, Benjamin Callac, Eric Maisel

We provide a unified framework in which the three emotions at the heart of narrative tension (curiosity, suspense and surprise) are formalized. This framework is built on nonmonotonic reasoning which allows us to compact…

Computational Curiosity (A Book Draft)

2015-02-17 · Qiong Wu

This book discusses computational curiosity, from the psychology of curiosity to the computational models of curiosity, and then showcases several interesting applications of computational curiosity. A brief overview of …

Recommendation Systems

The growth and form of knowledge networks by kinesthetic curiosity

2020-06-04 · Dale Zhou, David M. Lydon-Staley, Perry Zurn, Danielle S. Bassett

Throughout life, we might seek a calling, companions, skills, entertainment, truth, self-knowledge, beauty, and edification. The practice of curiosity can be viewed as an extended and open-ended search for valuable infor…

FormModel-based Reinforcement LearningPhilosophy

Ask & Explore: Grounded Question Answering for Curiosity-Driven Exploration

2021-04-24 · Jivat Neet Kaur, Yiding Jiang, Paul Pu Liang

In many real-world scenarios where extrinsic rewards to the agent are extremely sparse, curiosity has emerged as a useful concept providing intrinsic rewards that enable the agent to explore its environment and acquire i…

Question Answering