Knowledge-Based Sequential Decision-Making Under Uncertainty

2019-05-16 · Daoming Lyu

Deep reinforcement learning (DRL) algorithms have achieved great success on sequential decision-making problems, yet is criticized for the lack of data-efficiency and explainability. Especially, explainability of subtasks is critical in hierarchical decision-making since it enhances the transparency of black-box-style DRL methods and helps the RL practitioners to understand the high-level behavior of the system better. To improve the data-efficiency and explainability of DRL, declarative knowledge is introduced in this work and a novel algorithm is proposed by integrating DRL with symbolic planning. Experimental analysis on publicly available benchmarks validates the explainability of the subtasks and shows that our method can outperform the state-of-the-art approach in terms of data-efficiency.

📄 PDF Abstract BibTeX arXiv:1905.07030

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDecision Making Under UncertaintyDeep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Sequential Decision Making

A Survey of Knowledge-based Sequential Decision Making under Uncertainty

2020-08-19 · Shiqi Zhang, Mohan Sridharan

Reasoning with declarative knowledge (RDK) and sequential decision-making (SDM) are two key research areas in artificial intelligence. RDK methods reason with declarative domain knowledge, including commonsense knowledge…

Decision Making Decision Making Under Uncertainty reinforcement-learning Reinforcement Learning (RL)+1

Playing against Nature: causal discovery for decision making under uncertainty

2018-07-03 · M. Gonzalez-Soto, L. E. Sucar, H. J. Escalante

We consider decision problems under uncertainty where the options available to a decision maker and the resulting outcome are related through a causal mechanism which is unknown to the decision maker. We ask how a decisi…

Causal Discovery Decision Making Decision Making Under Uncertainty Q-Learning+1

Learning and Reasoning for Robot Sequential Decision Making under Uncertainty

2019-01-16 · Saeid Amiri, Mohammad Shokrolah Shirazi, Shiqi Zhang

Robots frequently face complex tasks that require more than one action, where sequential decision-making (SDM) capabilities become necessary. The key contribution of this work is a robot SDM framework, called LCORPP, tha…

Decision Making Decision Making Under Uncertainty Sequential Decision Making State Estimation

Risk-Sensitive and Robust Model-Based Reinforcement Learning and Planning

2023-04-02 · Marc Rigter

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastroph…

Decision Making Model-based Reinforcement Learning Recommendation Systems reinforcement-learning+3

Learning Structural Weight Uncertainty for Sequential Decision-Making

2017-12-30 · Ruiyi Zhang, Chunyuan Li, Changyou Chen, Lawrence Carin

Learning probability distributions on the weights of neural networks (NNs) has recently proven beneficial in many applications. Bayesian methods, such as Stein variational gradient descent (SVGD), offer an elegant framew…

Decision Making Multi-Armed Bandits Reinforcement Learning Reinforcement Learning (RL)+1