Tree Search in DAG Space with Model-based Reinforcement Learning for Causal Discovery
Identifying causal structure is central to many fields ranging from strategic decision-making to biology and economics. In this work, we propose CD-UCT, a model-based reinforcement learning method for causal discovery based on tree search that builds directed acyclic graphs incrementally. We also formalize and prove the correctness of an efficient algorithm for excluding edges that would introduce cycles, which enables deeper discrete search and sampling in DAG space. The proposed method can be applied broadly to causal Bayesian networks with both discrete and continuous random variables. We conduct a comprehensive evaluation on synthetic and real-world datasets, showing that CD-UCT substantially outperforms the state-of-the-art model-free reinforcement learning technique and greedy search, constituting a promising advancement for combinatorial methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal DiscoveryDecision MakingModel-based Reinforcement Learningreinforcement-learningReinforcement LearningSimilar Papers 제목 키워드 기반
Reinforcement Learning for Causal Discovery without Acyclicity Constraints
Recently, reinforcement learning (RL) has proved a promising alternative for conventional local heuristics in score-based approaches to learning directed acyclic causal graphs (DAGs) from observational data. However, the…
Causal DiscoveryEfficient ExplorationNavigatePolicy Gradient Methods+3CauSight: Learning to Supersense for Visual Causal Discovery
Causal thinking enables humans to understand not just what is seen, but why it happens. To replicate this capability in modern AI systems, we introduce the task of visual causal discovery. It requires models to infer cau…
Reinforcement LearningOrdering-Based Causal Discovery with Reinforcement Learning
It is a long-standing question to discover causal relations among a set of variables in many empirical sciences. Recently, Reinforcement Learning (RL) has achieved promising results in causal discovery from observational…
Causal DiscoveryDecoderreinforcement-learningReinforcement Learning+2Context-Specific Causal Discovery for Categorical Data Using Staged Trees
Causal discovery algorithms aim at untangling complex causal relationships from data. Here, we study causal discovery and inference methods based on staged tree models, which can represent complex and asymmetric causal r…
Causal DiscoveryCausal InferenceExact discovery is polynomial for certain sparse causal Bayesian networks
Causal Bayesian networks are widely used tools for summarising the dependencies between variables and elucidating their putative causal relationships. By restricting the search to trees, for example, learning the optimum…
Causal Discovery