A Discussion on Generalization in Next-Activity Prediction
Next activity prediction aims to forecast the future behavior of running process instances. Recent publications in this field predominantly employ deep learning techniques and evaluate their prediction performance using publicly available event logs. This paper presents empirical evidence that calls into question the effectiveness of these current evaluation approaches. We show that there is an enormous amount of example leakage in all of the commonly used event logs, so that rather trivial prediction approaches perform almost as well as ones that leverage deep learning. We further argue that designing robust evaluations requires a more profound conceptual engagement with the topic of next-activity prediction, and specifically with the notion of generalization to new data. To this end, we present various prediction scenarios that necessitate different types of generalization to guide future research.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity PredictionDeep LearningPredictionSimilar Papers 제목 키워드 기반
Context-aware multi-head self-attentional neural network model for next location prediction
Accurate activity location prediction is a crucial component of many mobility applications and is particularly required to develop personalized, sustainable transportation systems. Despite the widespread adoption of deep…
PredictionA High-Level Model of Neocortical Feedback Based on an Event Window Segmentation Algorithm
The author previously presented an event window segmentation (EWS) algorithm [5] that uses purely statistical methods to learn to recognize recurring patterns in an input stream of events. In the following discussion, th…
Goal-Oriented Next Best Activity Recommendation using Reinforcement Learning
Recommending a sequence of activities for an ongoing case requires that the recommendations conform to the underlying business process and meet the performance goal of either completion time or process outcome. Existing …
Activity Predictionreinforcement-learningReinforcement LearningReinforcement Learning (RL)Working My Way Back to You: Resource-Centric Next-Activity Prediction
Predictive Process Monitoring (PPM) aims to train models that forecast upcoming events in process executions. These predictions support early bottleneck detection, improved scheduling, proactive interventions, and timely…
Activity PredictionPrescriptive Business Process Monitoring for Recommending Next Best Actions
Predictive business process monitoring (PBPM) techniques predict future process behaviour based on historical event log data to improve operational business processes. Concerning the next activity prediction, recent PBPM…
Activity Prediction