Extrapolation in Statistical Learning with Extreme Value Theory
Extreme value theory provides rigorous theory and statistical tools for extrapolation in machine learning, particularly in settings where traditional methods struggle due to data scarcity in the tails. A broad range of tasks benefit from these advances, including regression and classification beyond the training data, extreme quantile regression, supervised and unsupervised dimension reduction, generative artificial intelligence and anomaly detection. This review synthesizes recent developments in these fields at the intersection of statistical learning and extreme value theory, with a focus on principled methods based on asymptotically motivated representations of the tail of univariate and multivariate distributions. We consider different theoretical frameworks for both asymptotically dependent and independent data and discuss how they translate into efficient statistical methods for extrapolation to extreme regions. By addressing both theoretical and practical aspects, we offer a comprehensive overview of the state-of-the-art in this quickly evolving field, and identify promising directions for future research.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionSimilar Papers 제목 키워드 기반
Assessing Extrapolation of Peaks Over Thresholds with Martingale Testing
We present the winning strategy for the EVA2025 Data Challenge, which aimed to estimate the probability of extreme precipitation events. These events occurred at most once in the dataset making the challenge fundamentall…
Estimation of Treatment Effects in Extreme and Unobserved Data
Causal effect estimation seeks to determine the impact of an intervention from observational data. However, the existing causal inference literature primarily addresses treatment effects on frequently occurring events. B…
Causal InferenceWireless Channel Modeling Based on Extreme Value Theory for Ultra-Reliable Communications
A key building block in the design of ultra-reliable communication systems is a wireless channel model that captures the statistics of rare events occurring due to significant fading. In this paper, we propose a novel me…
Risk-Averse Action Selection Using Extreme Value Theory Estimates of the CVaR
In a wide variety of sequential decision making problems, it can be important to estimate the impact of rare events in order to minimize risk exposure. A popular risk measure is the conditional value-at-risk (CVaR), whic…
Decision MakingReinforcement LearningSequential Decision MakingLSTM-Based Anomaly Detection: Detection Rules from Extreme Value Theory
In this paper, we explore various statistical techniques for anomaly detection in conjunction with the popular Long Short-Term Memory (LSTM) deep learning model for transportation networks. We obtain the prediction error…
Anomaly DetectionPrediction