paper-with-me

홈 › Papers

Accelerating Ensemble Error Bar Prediction with Single Models Fits

2024-04-15 · Vidit Agrawal, ShiXin Zhang, Lane E. Schultz, Dane Morgan

Ensemble models can be used to estimate prediction uncertainties in machine learning models. However, an ensemble of N models is approximately N times more computationally demanding compared to a single model when it is used for inference. In this work, we explore fitting a single model to predicted ensemble error bar data, which allows us to estimate uncertainties without the need for a full ensemble. Our approach is based on three models: Model A for predictive accuracy, Model $A_{E}$ for traditional ensemble-based error bar prediction, and Model B, fit to data from Model $A_{E}$, to be used for predicting the values of $A_{E}$ but with only one model evaluation. Model B leverages synthetic data augmentation to estimate error bars efficiently. This approach offers a highly flexible method of uncertainty quantification that can approximate that of ensemble methods but only requires a single extra model evaluation over Model A during inference. We assess this approach on a set of problems in materials science.

📄 PDF Abstract BibTeX arXiv:2404.09896

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationPredictionUncertainty Quantification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Ensemble Distillation Approaches for Grammatical Error Correction

2020-11-24 · Yassir Fathullah, Mark Gales, Andrey Malinin

Ensemble approaches are commonly used techniques to improving a system by combining multiple model predictions. Additionally these schemes allow the uncertainty, as well as the source of the uncertainty, to be derived fo…

Grammatical Error CorrectionPrediction

Training independent subnetworks for robust prediction

2020-10-13 · ICLR 2021 1 · Marton Havasi, Rodolphe Jenatton, Stanislav Fort, Jeremiah Zhe Liu 외

Recent approaches to efficiently ensemble neural networks have shown that strong robustness and uncertainty performance can be achieved with a negligible gain in parameters over the original network. However, these metho…

Prediction

Histogram Transform Ensembles for Density Estimation

2019-11-24 · Hanyuan Hang

We investigate an algorithm named histogram transform ensembles (HTE) density estimator whose effectiveness is supported by both solid theoretical analysis and significant experimental performance. On the theoretical sid…

Density Estimation

Semi-Supervised Learning for Molecular Graphs via Ensemble Consensus

2026-07-30 · Rasmus Tirsgaard, Laurits Fredsgaard, Marisa Wodrich, Mikkel Jordahn 외 arxiv

Machine learning is transforming molecular sciences by accelerating property prediction, simulation, and the discovery of new molecules and materials. Acquiring labeled data in these domains is often costly and time-cons…

Knowledge DistillationGraph Neural Network

Ensemble Distillation for Structured Prediction: Calibrated, Accurate, Fast-Choose Three

2020-10-13 · EMNLP 2020 11 · Steven Reich, David Mueller, Nicholas Andrews

Modern neural networks do not always produce well-calibrated predictions, even when trained with a proper scoring function such as cross-entropy. In classification settings, simple methods such as isotonic regression or …

Machine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2