paper-with-me

홈 › Papers

Rare-Event Simulation for Neural Network and Random Forest Predictors

2020-10-10 · Yuanlu Bai, Zhiyuan Huang, Henry Lam, Ding Zhao

We study rare-event simulation for a class of problems where the target hitting sets of interest are defined via modern machine learning tools such as neural networks and random forests. This problem is motivated from fast emerging studies on the safety evaluation of intelligent systems, robustness quantification of learning models, and other potential applications to large-scale simulation in which machine learning tools can be used to approximate complex rare-event set boundaries. We investigate an importance sampling scheme that integrates the dominating point machinery in large deviations and sequential mixed integer programming to locate the underlying dominating points. Our approach works for a range of neural network architectures including fully connected layers, rectified linear units, normalization, pooling and convolutional layers, and random forests built from standard decision trees. We provide efficiency guarantees and numerical demonstration of our approach using a classification model in the UCI Machine Learning Repository.

📄 PDF Abstract BibTeX arXiv:2010.04890

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

Understanding overfitting in random forest for probability estimation: a visualization and simulation study

2024-02-28 · Lasai Barreñada, Paula Dhiman, Dirk Timmerman, Anne-Laure Boulesteix 외

Random forests have become popular for clinical risk prediction modelling. In a case study on predicting ovarian malignancy, we observed training c-statistics close to 1. Although this suggests overfitting, performance w…

Random survival forests with multivariate longitudinal endogenous covariates

2022-08-11 · Anthony Devaux, Catherine Helmer, Robin Genuer, Cécile Proust-Lima

Predicting the individual risk of a clinical event using the complete patient history is still a major challenge for personalized medicine. Among the methods developed to compute individual dynamic predictions, the joint…

Random Forests for time-fixed and time-dependent predictors: The DynForest R package

2023-02-06 · Anthony Devaux, Cécile Proust-Lima, Robin Genuer

The R package DynForest implements random forests for predicting a continuous, a categorical or a (multiple causes) time-to-event outcome based on time-fixed and time-dependent predictors. The main originality of DynFore…

Predicting Value at Risk for Cryptocurrencies With Generalized Random Forests

2022-02-24 · Rebekka Buse, Konstantin Görgen, Melanie Schienle

We study the prediction of Value at Risk (VaR) for cryptocurrencies. In contrast to classic assets, returns of cryptocurrencies are often highly volatile and characterized by large fluctuations around single events. Anal…

quantile regression

Advancing Machine Learning in Industry 4.0: Benchmark Framework for Rare-event Prediction in Chemical Processes

2024-08-31 · Vikram Sudarshan, Warren D. Seider

Previously, using forward-flux sampling (FFS) and machine learning (ML), we developed multivariate alarm systems to counter rare un-postulated abnormal events. Our alarm systems utilized ML-based predictive models to qua…

Computational Efficiency