paper-with-me

홈 › Papers

Alpha-DAG: a reinforcement learning based algorithm to learn Directed Acyclic Graphs

2021-01-01 · Fan Zhou, Yifeng Pan, Shenghua Zhu, Xin He

Directed acyclic graphs (DAGs) are widely used to model the casual relationships among random variables in many disciplines. One major class of algorithms for DAGs is called `search-and-score', which attempts to maximize some goodness-of-fit measure and returns a DAG with the best score. However, most existing methods highly rely on their model assumptions and cannot be applied to the more general real-world problems. This paper proposes a novel Reinforcement-Learning-based searching algorithm, Alpha-DAG, which gradually finds the optimal order to add edges by learning from the historical searching trajectories. At each decision window, the agent adds the edge with the largest scoring improvement to the current graph. The advantage of Alpha-DAG is supported by the numerical comparison against some state-of-the-art competitors in both synthetic and real examples.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Policy Gradient RL Algorithms as Directed Acyclic Graphs

2020-12-14 · Juan Jose Garau Luis

Meta Reinforcement Learning (RL) methods focus on automating the design of RL algorithms that generalize to a wide range of environments. The framework introduced in (Anonymous, 2020) addresses the problem by representin…

Meta Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Monte-Carlo Graph Search for AlphaZero

2020-12-20 · Johannes Czech, Patrick Korus, Kristian Kersting

The AlphaZero algorithm has been successfully applied in a range of discrete domains, most notably board games. It utilizes a neural network, that learns a value and policy function to guide the exploration in a Monte-Ca…

Board Games

Multilevel Acyclic Hypergraph Partitioning

2020-02-06 · Merten Popp, Sebastian Schlag, Christian Schulz, Daniel Seemaier

A directed acyclic hypergraph is a generalized concept of a directed acyclic graph, where each hyperedge can contain an arbitrary number of tails and heads. Directed hypergraphs can be used to model data flow and executi…

hypergraph partitioningScheduling

Deep Q-Learning for Directed Acyclic Graph Generation

2019-06-05 · Laura D'Arcy, Padraig Corcoran, Alun Preece

We present a method to generate directed acyclic graphs (DAGs) using deep reinforcement learning, specifically deep Q-learning. Generating graphs with specified structures is an important and challenging task in various …

Deep Reinforcement LearningGraph GenerationQ-Learningreinforcement-learning+2

Bayesian Soft Actor-Critic: A Directed Acyclic Strategy Graph Based Deep Reinforcement Learning

2022-08-11 · Qin Yang, Ramviyas Parasuraman

Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system's utility, decrease the overall…

continuous-controlContinuous ControlDeep Reinforcement LearningOpenAI Gym+2