Causal Deep Q Network
Deep Q Networks (DQN) have shown remarkable success in various reinforcement learning tasks. However, their reliance on associative learning often leads to the acquisition of spurious correlations, hindering their problem-solving capabilities. In this paper, we introduce a novel approach to integrate causal principles into DQNs, leveraging the PEACE (Probabilistic Easy vAriational Causal Effect) formula for estimating causal effects. By incorporating causal reasoning during training, our proposed framework enhances the DQN's understanding of the underlying causal structure of the environment, thereby mitigating the influence of confounding factors and spurious correlations. We demonstrate that integrating DQNs with causal capabilities significantly enhances their problem-solving capabilities without compromising performance. Experimental results on standard benchmark environments showcase that our approach outperforms conventional DQNs, highlighting the effectiveness of causal reasoning in reinforcement learning. Overall, our work presents a promising avenue for advancing the capabilities of deep reinforcement learning agents through principled causal inference.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningCausal InferenceSimilar Papers 제목 키워드 기반
CausalFormer: An Interpretable Transformer for Temporal Causal Discovery
Temporal causal discovery is a crucial task aimed at uncovering the causal relations within time series data. The latest temporal causal discovery methods usually train deep learning models on prediction tasks to uncover…
Causal DiscoveryTime SeriesCausal Learner: A Toolbox for Causal Structure and Markov Blanket Learning
Causal Learner is a toolbox for learning causal structure and Markov blanket (MB) from data. It integrates functions for generating simulated Bayesian network data, a set of state-of-the-art global causal structure learn…
Causal Agent based on Large Language Model
Large language models (LLMs) have achieved significant success across various domains. However, the inherent complexity of causal problems and causal theory poses challenges in accurately describing them in natural langu…
Language ModelingLanguage ModellingLarge Language ModelmodelCausal Counterfactuals for Improving the Robustness of Reinforcement Learning
Reinforcement learning (RL) is used in various robotic applications. RL enables agents to learn tasks autonomously by interacting with the environment. The more critical the tasks are, the higher the demand for the robus…
Causal Inferencereinforcement-learningReinforcement LearningReinforcement Learning (RL)+1CausalLP: Learning causal relations with weighted knowledge graph link prediction
Causal networks are useful in a wide variety of applications, from medical diagnosis to root-cause analysis in manufacturing. In practice, however, causal networks are often incomplete with missing causal relations. This…
Causal DiscoveryGraph EmbeddingKnowledge Graph CompletionKnowledge Graph Embedding+4