Timing Process Interventions with Causal Inference and Reinforcement Learning
The shift from the understanding and prediction of processes to their optimization offers great benefits to businesses and other organizations. Precisely timed process interventions are the cornerstones of effective optimization. Prescriptive process monitoring (PresPM) is the sub-field of process mining that concentrates on process optimization. The emerging PresPM literature identifies state-of-the-art methods, causal inference (CI) and reinforcement learning (RL), without presenting a quantitative comparison. Most experiments are carried out using historical data, causing problems with the accuracy of the methods' evaluations and preempting online RL. Our contribution consists of experiments on timed process interventions with synthetic data that renders genuine online RL and the comparison to CI possible, and allows for an accurate evaluation of the results. Our experiments reveal that RL's policies outperform those from CI and are more robust at the same time. Indeed, the RL policies approach perfect policies. Unlike CI, the unaltered online RL approach can be applied to other, more generic PresPM problems such as next best activity recommendations. Nonetheless, CI has its merits in settings where online learning is not an option.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal Inferencereinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
A Meta-Reinforcement Learning Algorithm for Causal Discovery
Causal discovery is a major task with the utmost importance for machine learning since causal structures can enable models to go beyond pure correlation-based inference and significantly boost their performance. However,…
Causal DiscoveryMeta Reinforcement Learningreinforcement-learningReinforcement Learning+1Bayesian causal inference via probabilistic program synthesis
Causal inference can be formalized as Bayesian inference that combines a prior distribution over causal models and likelihoods that account for both observations and interventions. We show that it is possible to implemen…
Bayesian InferenceCausal InferenceProbabilistic ProgrammingProgram SynthesisNetwork Topology Inference based on Timing Meta-Data
Consider a processor having access only to meta-data consisting of the timings of data packets and acknowledgment (ACK) packets from all nodes in a network. The meta-data report the source node of each packet, but not th…
Causal Reasoning from Meta-reinforcement Learning
Discovering and exploiting the causal structure in the environment is a crucial challenge for intelligent agents. Here we explore whether causal reasoning can emerge via meta-reinforcement learning. We train a recurrent …
counterfactualMeta Reinforcement Learningreinforcement-learningReinforcement Learning+1Towards intervention-centric causal reasoning in learning agents
Interventions are central to causal learning and reasoning. Yet ultimately an intervention is an abstraction: an agent embedded in a physical environment (perhaps modeled as a Markov decision process) does not typically …
Deep Reinforcement LearningMeta-LearningMeta Reinforcement Learningreinforcement-learning+2