Curiosity in exploring chemical space: Intrinsic rewards for deep molecular reinforcement learning

2020-12-17 · Luca A. Thiede, Mario Krenn, AkshatKumar Nigam, Alan Aspuru-Guzik

Computer-aided design of molecules has the potential to disrupt the field of drug and material discovery. Machine learning, and deep learning, in particular, have been topics where the field has been developing at a rapid pace. Reinforcement learning is a particularly promising approach since it allows for molecular design without prior knowledge. However, the search space is vast and efficient exploration is desirable when using reinforcement learning agents. In this study, we propose an algorithm to aid efficient exploration. The algorithm is inspired by a concept known in the literature as curiosity. We show on three benchmarks that a curious agent finds better performing molecules. This indicates an exciting new research direction for reinforcement learning agents that can explore the chemical space out of their own motivation. This has the potential to eventually lead to unexpected new molecules that no human has thought about so far.

📄 PDF Abstract BibTeX arXiv:2012.11293

Code (0)

등록된 구현이 없습니다.

Tasks

Efficient Explorationreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Exploring through Random Curiosity with General Value Functions

2022-11-18 · Aditya Ramesh, Louis Kirsch, Sjoerd van Steenkiste, Jürgen Schmidhuber

Efficient exploration in reinforcement learning is a challenging problem commonly addressed through intrinsic rewards. Recent prominent approaches are based on state novelty or variants of artificial curiosity. However, …

Efficient Exploration

Intrinsically motivated graph exploration using network theories of human curiosity

2023-07-11 · Shubhankar P. Patankar, Mathieu Ouellet, Juan Cervino, Alejandro Ribeiro 외

Intrinsically motivated exploration has proven useful for reinforcement learning, even without additional extrinsic rewards. When the environment is naturally represented as a graph, how to guide exploration best remains…

Graph Neural Network Recommendation Systems reinforcement-learning Reinforcement Learning

Large-Scale Study of Curiosity-Driven Learning

2018-08-13 · ICLR 2019 5 · Yuri Burda, Harri Edwards, Deepak Pathak, Amos Storkey 외

Reinforcement learning algorithms rely on carefully engineering environment rewards that are extrinsic to the agent. However, annotating each environment with hand-designed, dense rewards is not scalable, motivating the …

Atari Games Prediction Reinforcement Learning SNES Games

Curiosity-driven Exploration in Sparse-reward Multi-agent Reinforcement Learning

2023-02-21 · Jiong Li, Pratik Gajane

Sparsity of rewards while applying a deep reinforcement learning method negatively affects its sample-efficiency. A viable solution to deal with the sparsity of rewards is to learn via intrinsic motivation which advocate…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Nuclear Norm Maximization Based Curiosity-Driven Learning

2022-05-21 · Chao Chen, Zijian Gao, Kele Xu, Sen yang 외

To handle the sparsity of the extrinsic rewards in reinforcement learning, researchers have proposed intrinsic reward which enables the agent to learn the skills that might come in handy for pursuing the rewards in the f…

Atari Games