Extending the Entropic Potential of Events for Uncertainty Quantification and Decision-Making in Artificial Intelligence
This work demonstrates how the concept of the entropic potential of events -- a parameter quantifying the influence of discrete events on the expected future entropy of a system -- can enhance uncertainty quantification, decision-making, and interpretability in artificial intelligence (AI). Building on its original formulation in physics, the framework is adapted for AI by introducing an event-centric measure that captures how actions, observations, or other discrete occurrences impact uncertainty at future time horizons. Both the original and AI-adjusted definitions of entropic potential are formalized, with the latter emphasizing conditional expectations to account for counterfactual scenarios. Applications are explored in policy evaluation, intrinsic reward design, explainable AI, and anomaly detection, highlighting the metric's potential to unify and strengthen uncertainty modeling in intelligent systems. Conceptual examples illustrate its use in reinforcement learning, Bayesian inference, and anomaly detection, while practical considerations for computation in complex AI models are discussed. The entropic potential framework offers a theoretically grounded, interpretable, and versatile approach to managing uncertainty in AI, bridging principles from thermodynamics, information theory, and machine learning.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningBayesian InferenceAnomaly DetectionSimilar Papers 제목 키워드 기반
Uncertainty Quantification in LV State Estimation Under High Shares of Flexible Resources
The ongoing electrification introduces new challenges to distribution system operators (DSOs). Controllable resources may simultaneously react to price signals, potentially leading to network violations. DSOs require rel…
Decision Makingquantile regressionState EstimationUncertainty QuantificationCash non-additive risk measures: horizon risk and generalized entropy
Horizon risk (see arXiv:2301.04971) is studied in the context of cash non-additive fully-dynamic risk measures induced by BSDEs. Furthermore, we introduce a risk measure based on generalized Tsallis entropy which can dyn…
Bayesian Neural Hawkes Process for Event Uncertainty Prediction
Event data consisting of time of occurrence of the events arises in several real-world applications. Recent works have introduced neural network based point processes for modeling event-times, and were shown to provide s…
Decision MakingPoint ProcessesPredictionUncertainty QuantificationSMURF-THP: Score Matching-based UnceRtainty quantiFication for Transformer Hawkes Process
Transformer Hawkes process models have shown to be successful in modeling event sequence data. However, most of the existing training methods rely on maximizing the likelihood of event sequences, which involves calculati…
PredictionType predictionUncertainty QuantificationOutput-Weighted Optimal Sampling for Bayesian Experimental Design and Uncertainty Quantification
We introduce a class of acquisition functions for sample selection that leads to faster convergence in applications related to Bayesian experimental design and uncertainty quantification. The approach follows the paradig…
Active LearningExperimental DesignUncertainty Quantification