paper-with-me

홈 › Papers

A Comprehensive Survey on Rare Event Prediction

2023-09-20 · Chathurangi Shyalika, Ruwan Wickramarachchi, Amit Sheth

Rare event prediction involves identifying and forecasting events with a low probability using machine learning (ML) and data analysis. Due to the imbalanced data distributions, where the frequency of common events vastly outweighs that of rare events, it requires using specialized methods within each step of the ML pipeline, i.e., from data processing to algorithms to evaluation protocols. Predicting the occurrences of rare events is important for real-world applications, such as Industry 4.0, and is an active research area in statistical and ML. This paper comprehensively reviews the current approaches for rare event prediction along four dimensions: rare event data, data processing, algorithmic approaches, and evaluation approaches. Specifically, we consider 73 datasets from different modalities (i.e., numerical, image, text, and audio), four major categories of data processing, five major algorithmic groupings, and two broader evaluation approaches. This paper aims to identify gaps in the current literature and highlight the challenges of predicting rare events. It also suggests potential research directions, which can help guide practitioners and researchers.

📄 PDF Abstract BibTeX arXiv:2309.11356

Code (0)

등록된 구현이 없습니다.

Tasks

PredictionSurvey

Similar Papers 제목 키워드 기반

Beyond the Norm: A Survey of Synthetic Data Generation for Rare Events

2025-06-04 · Jingyi Gu, Xuan Zhang, Guiling Wang

Extreme events, such as market crashes, natural disasters, and pandemics, are rare but catastrophic, often triggering cascading failures across interconnected systems. Accurate prediction and early warning can help minim…

Synthetic Data Generation

Advancing Machine Learning in Industry 4.0: Benchmark Framework for Rare-event Prediction in Chemical Processes

2024-08-31 · Vikram Sudarshan, Warren D. Seider

Previously, using forward-flux sampling (FFS) and machine learning (ML), we developed multivariate alarm systems to counter rare un-postulated abnormal events. Our alarm systems utilized ML-based predictive models to qua…

Computational Efficiency

A Comprehensive Survey on Graph Anomaly Detection with Deep Learning

2021-06-14 · Xiaoxiao Ma, Jia Wu, Shan Xue, Jian Yang 외

Anomalies represent rare observations (e.g., data records or events) that deviate significantly from others. Over several decades, research on anomaly mining has received increasing interests due to the implications of t…

Anomaly DetectionDeep LearningGraph Anomaly DetectionSurvey

Event Prediction in the Big Data Era: A Systematic Survey

2020-07-19 · Liang Zhao

Events are occurrences in specific locations, time, and semantics that nontrivially impact either our society or the nature, such as civil unrest, system failures, and epidemics. It is highly desirable to be able to anti…

Information RetrievalPredictionSurvey

A Survey on Deep Learning Event Extraction: Approaches and Applications

2021-07-05 · Qian Li, JianXin Li, Jiawei Sheng, Shiyao Cui 외

Event extraction (EE) is a crucial research task for promptly apprehending event information from massive textual data. With the rapid development of deep learning, EE based on deep learning technology has become a resea…

Deep LearningEvent ExtractionSurvey