Learning Symbolic Rules for Interpretable Deep Reinforcement Learning

2021-03-15 · Zhihao Ma, Yuzheng Zhuang, Paul Weng, Hankz Hankui Zhuo, Dong Li, Wulong Liu, Jianye Hao

Recent progress in deep reinforcement learning (DRL) can be largely attributed to the use of neural networks. However, this black-box approach fails to explain the learned policy in a human understandable way. To address this challenge and improve the transparency, we propose a Neural Symbolic Reinforcement Learning framework by introducing symbolic logic into DRL. This framework features a fertilization of reasoning and learning modules, enabling end-to-end learning with prior symbolic knowledge. Moreover, interpretability is achieved by extracting the logical rules learned by the reasoning module in a symbolic rule space. The experimental results show that our framework has better interpretability, along with competing performance in comparison to state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2103.08228

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Neuro-Symbolic Approaches for Text-Based Policy Learning

2021-11-01 · EMNLP 2021 11 · Subhajit Chaudhury, Prithviraj Sen, Masaki Ono, Daiki Kimura 외

Text-Based Games (TBGs) have emerged as important testbeds for reinforcement learning (RL) in the natural language domain. Previous methods using LSTM-based action policies are uninterpretable and often overfit the train…

Reinforcement Learning (RL)text-based games

Neuro-Symbolic Hierarchical Rule Induction

2021-12-26 · Claire Glanois, Xuening Feng, Zhaohui Jiang, Paul Weng 외

We propose an efficient interpretable neuro-symbolic model to solve Inductive Logic Programming (ILP) problems. In this model, which is built from a set of meta-rules organised in a hierarchical structure, first-order ru…

Inductive logic programming reinforcement-learning Reinforcement Learning (RL)

Interpretable Reinforcement Learning With Neural Symbolic Logic

2021-01-01 · Zhihao Ma, Yuzheng Zhuang, Paul Weng, Dong Li 외

Deep Reinforcement Learning Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Learning Symbolic Rules over Abstract Meaning Representations for Textual Reinforcement Learning

2023-07-05 · Subhajit Chaudhury, Sarathkrishna Swaminathan, Daiki Kimura, Prithviraj Sen 외

Text-based reinforcement learning agents have predominantly been neural network-based models with embeddings-based representation, learning uninterpretable policies that often do not generalize well to unseen games. On t…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Representation Learning

Neuro-Symbolic Reinforcement Learning with First-Order Logic

2021-10-21 · EMNLP 2021 11 · Daiki Kimura, Masaki Ono, Subhajit Chaudhury, Ryosuke Kohita 외

Deep reinforcement learning (RL) methods often require many trials before convergence, and no direct interpretability of trained policies is provided. In order to achieve fast convergence and interpretability for the pol…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1