Symbolic Relational Deep Reinforcement Learning based on Graph Neural Networks and Autoregressive Policy Decomposition
We focus on reinforcement learning (RL) in relational problems that are naturally defined in terms of objects, their relations, and object-centric actions. These problems are characterized by variable state and action spaces, and finding a fixed-length representation, required by most existing RL methods, is difficult, if not impossible. We present a deep RL framework based on graph neural networks and auto-regressive policy decomposition that naturally works with these problems and is completely domain-independent. We demonstrate the framework's broad applicability in three distinct domains and show impressive zero-shot generalization over different problem sizes.
Code (1)
Tasks
Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Zero-shot GeneralizationSimilar Papers 제목 키워드 기반
Deep Explainable Relational Reinforcement Learning: A Neuro-Symbolic Approach
Despite numerous successes in Deep Reinforcement Learning (DRL), the learned policies are not interpretable. Moreover, since DRL does not exploit symbolic relational representations, it has difficulties in coping with st…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningInterpretable Reinforcement Learning With Neural Symbolic Logic
Recent progress in deep reinforcement learning (DRL) can be largely attributed to the use of neural networks. However, this black-box approach fails to explain the learned policy in a human understandable way. To addre…
Deep Reinforcement LearningHierarchical Reinforcement Learningreinforcement-learningReinforcement Learning+2Learning Relational Rules from Rewards
Humans perceive the world in terms of objects and relations between them. In fact, for any given pair of objects, there is a myriad of relations that apply to them. How does the cognitive system learn which relations are…
Atari GamesGenerating Programmatic Referring Expressions via Program Synthesis
Incorporating symbolic reasoning into machine learning algorithms is a promising approach to improve performance on learning tasks that require logical reasoning. We study the problem of generating a programmatic variant…
Enumerative SearchLogical ReasoningProgram SynthesisA Comparative Study of Distributional and Symbolic Paradigms for Relational Learning
Many real-world domains can be expressed as graphs and, more generally, as multi-relational knowledge graphs. Though reasoning and learning with knowledge graphs has traditionally been addressed by symbolic approaches, r…
ClusteringGeneral ClassificationKnowledge Base CompletionKnowledge Graphs+2