BlendRL: A Framework for Merging Symbolic and Neural Policy Learning

2024-10-15 · Hikaru Shindo, Quentin Delfosse, Devendra Singh Dhami, Kristian Kersting

Humans can leverage both symbolic reasoning and intuitive reactions. In contrast, reinforcement learning policies are typically encoded in either opaque systems like neural networks or symbolic systems that rely on predefined symbols and rules. This disjointed approach severely limits the agents' capabilities, as they often lack either the flexible low-level reaction characteristic of neural agents or the interpretable reasoning of symbolic agents. To overcome this challenge, we introduce BlendRL, a neuro-symbolic RL framework that harmoniously integrates both paradigms within RL agents that use mixtures of both logic and neural policies. We empirically demonstrate that BlendRL agents outperform both neural and symbolic baselines in standard Atari environments, and showcase their robustness to environmental changes. Additionally, we analyze the interaction between neural and symbolic policies, illustrating how their hybrid use helps agents overcome each other's limitations.

📄 PDF Abstract BibTeX arXiv:2410.11689

Code (0)

등록된 구현이 없습니다.

Neurosymbolic Reinforcement Learning and Planning: A Survey

2023-09-02 · K. Acharya, W. Raza, C. M. J. M. Dourado Jr, A. Velasquez 외

The area of Neurosymbolic Artificial Intelligence (Neurosymbolic AI) is rapidly developing and has become a popular research topic, encompassing sub-fields such as Neurosymbolic Deep Learning (Neurosymbolic DL) and Neuro…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Survey

Neurosymbolic Reinforcement Learning with Formally Verified Exploration

2020-09-26 · NeurIPS 2020 12 · Greg Anderson, Abhinav Verma, Isil Dillig, Swarat Chaudhuri

We present Revel, a partially neural reinforcement learning (RL) framework for provably safe exploration in continuous state and action spaces. A key challenge for provably safe deep RL is that repeatedly verifying neura…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Exploration

Efficient Symbolic Policy Learning with Differentiable Symbolic Expression

2023-11-02 · NeurIPS 2023 11

Deep reinforcement learning (DRL) has led to a wide range of advances in sequential decision-making tasks. However, the complexity of neural network policies makes it difficult to understand and deploy with limited compu…

Decision Making Deep Reinforcement Learning Sequential Decision Making

PolicyGuard: From Organizational Policies to Neuro-SymbolicCompliance Review Engines

2026-06-30 · Sameer Malik, Ayush Singh, Amar Prakash Azad arxiv

Policy-grounded document review requires determining whether a target document complies with organization-specific policies, guidelines, or playbooks. While large language models can assist with policy interpretation and…

Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradients

2019-12-10 · ICLR 2021 1 · Brenden K. Petersen, Mikel Landajuela Larma, T. Nathan Mundhenk, Claudio P. Santiago 외

Discovering the underlying mathematical expressions describing a dataset is a core challenge for artificial intelligence. This is the problem of $\textit{symbolic regression}$. Despite recent advances in training neural …

regression Reinforcement Learning Symbolic Regression