Structural Positional Encoding for knowledge integration in transformer-based medical process monitoring
Predictive process monitoring is a process mining task aimed at forecasting information about a running process trace, such as the most correct next activity to be executed. In medical domains, predictive process monitoring can provide valuable decision support in atypical and nontrivial situations. Decision support and quality assessment in medicine cannot ignore domain knowledge, in order to be grounded on all the available information (which is not limited to data) and to be really acceptable by end users. In this paper, we propose a predictive process monitoring approach relying on the use of a {\em transformer}, a deep learning architecture based on the attention mechanism. A major contribution of our work lies in the incorporation of ontological domain-specific knowledge, carried out through a graph positional encoding technique. The paper presents and discusses the encouraging experimental result we are collecting in the domain of stroke management.
Code (1)
Tasks
Knowledge Graph EmbeddingManagementOntology EmbeddingPredictive Process MonitoringTemporal SequencesSimilar Papers 제목 키워드 기반
Homomorphism Counts as Structural Encodings for Graph Learning
Graph Transformers are popular neural networks that extend the well-known Transformer architecture to the graph domain. These architectures operate by applying self-attention on graph nodes and incorporating graph struct…
Graph LearningMolecular Property PredictionProperty PredictionGraph Neural Networks with Learnable Structural and Positional Representations
Graph neural networks (GNNs) have become the standard learning architectures for graphs. GNNs have been applied to numerous domains ranging from quantum chemistry, recommender systems to knowledge graphs and natural lang…
Graph RegressionKnowledge GraphsRecommendation SystemsGraph Transformers without Positional Encodings
Recently, Transformers for graph representation learning have become increasingly popular, achieving state-of-the-art performance on a wide-variety of graph datasets, either alone or in combination with message-passing g…
Graph ClassificationGraph RegressionGraph Representation LearningNode Classification+1Causality-Induced Positional Encoding for Transformer-Based Representation Learning of Non-Sequential Features
Positional encoding is essential for supplementing transformer with positional information of tokens. Existing positional encoding methods demand predefined token/feature order, rendering them unsuitable for real-world d…
Representation LearningStructural-Temporal Coupling Anomaly Detection with Dynamic Graph Transformer
Detecting anomalous edges in dynamic graphs is an important task in many applications over evolving triple-based data, such as social networks, transaction management, and epidemiology. A major challenge with this task i…
Anomaly DetectionEpidemiology