Towards Deep Symbolic Reinforcement Learning

2016-09-18 · Marta Garnelo, Kai Arulkumaran, Murray Shanahan

Deep reinforcement learning (DRL) brings the power of deep neural networks to bear on the generic task of trial-and-error learning, and its effectiveness has been convincingly demonstrated on tasks such as Atari video games and the game of Go. However, contemporary DRL systems inherit a number of shortcomings from the current generation of deep learning techniques. For example, they require very large datasets to work effectively, entailing that they are slow to learn even when such datasets are available. Moreover, they lack the ability to reason on an abstract level, which makes it difficult to implement high-level cognitive functions such as transfer learning, analogical reasoning, and hypothesis-based reasoning. Finally, their operation is largely opaque to humans, rendering them unsuitable for domains in which verifiability is important. In this paper, we propose an end-to-end reinforcement learning architecture comprising a neural back end and a symbolic front end with the potential to overcome each of these shortcomings. As proof-of-concept, we present a preliminary implementation of the architecture and apply it to several variants of a simple video game. We show that the resulting system -- though just a prototype -- learns effectively, and, by acquiring a set of symbolic rules that are easily comprehensible to humans, dramatically outperforms a conventional, fully neural DRL system on a stochastic variant of the game.

📄 PDF Abstract BibTeX arXiv:1609.05518

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningGame of Go reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Transfer Learning

PEORL: Integrating Symbolic Planning and Hierarchical Reinforcement Learning for Robust Decision-Making

2018-04-20 · Fangkai Yang, Daoming Lyu, Bo Liu, Steven Gustafson

Reinforcement learning and symbolic planning have both been used to build intelligent autonomous agents. Reinforcement learning relies on learning from interactions with real world, which often requires an unfeasibly lar…

Decision Making Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Neurosymbolic Reinforcement Learning and Planning: A Survey

2023-09-02 · K. Acharya, W. Raza, C. M. J. M. Dourado Jr, A. Velasquez 외

The area of Neurosymbolic Artificial Intelligence (Neurosymbolic AI) is rapidly developing and has become a popular research topic, encompassing sub-fields such as Neurosymbolic Deep Learning (Neurosymbolic DL) and Neuro…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Survey

Interpretable Reinforcement Learning With Neural Symbolic Logic

2021-01-01 · Zhihao Ma, Yuzheng Zhuang, Paul Weng, Dong Li 외

Recent progress in deep reinforcement learning (DRL) can be largely attributed to the use of neural networks. However, this black-box approach fails to explain the learned policy in a human understandable way. To addre…

Deep Reinforcement Learning Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Learning Symbolic Rules for Interpretable Deep Reinforcement Learning

2021-03-15 · Zhihao Ma, Yuzheng Zhuang, Paul Weng, Hankz Hankui Zhuo 외

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Neuro-symbolic Meta Reinforcement Learning for Trading

2023-01-15 · S I Harini, Gautam Shroff, Ashwin Srinivasan, Prayushi Faldu 외

We model short-duration (e.g. day) trading in financial markets as a sequential decision-making problem under uncertainty, with the added complication of continual concept-drift. We, therefore, employ meta reinforcement …

Decision Making Meta Reinforcement Learning Program induction reinforcement-learning+3