Non-Volatile Memory Accelerated Posterior Estimation
Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their predictions are wrong. To use more learnable parameter combinations efficiently, these samples must be drawn from the posterior distribution. Unfortunately computing the posterior directly is infeasible, so often researchers approximate it with a well known distribution such as a Gaussian. In this paper, we show that through the use of high-capacity persistent storage, models whose posterior distribution was too big to approximate are now feasible, leading to improved predictions in downstream tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceBIG-bench Machine LearningSimilar Papers 제목 키워드 기반
XBART: Accelerated Bayesian Additive Regression Trees
Bayesian additive regression trees (BART) (Chipman et. al., 2010) is a powerful predictive model that often outperforms alternative models at out-of-sample prediction. BART is especially well-suited to settings with unst…
regressionNon-Volatile Memory Accelerated Geometric Multi-Scale Resolution Analysis
Dimensionality reduction algorithms are standard tools in a researcher's toolbox. Dimensionality reduction algorithms are frequently used to augment downstream tasks such as machine learning, data science, and also are e…
Dimensionality ReductionBeware of Discarding Used SRAMs: Information is Stored Permanently
Data recovery has long been a focus of the electronics industry for decades by security experts, focusing on hard disk recovery, a type of non-volatile memory. Unfortunately, none of the existing research, neither from a…
RetrievalSequential Monte Carlo With Model Tempering
Modern macroeconometrics often relies on time series models for which it is time-consuming to evaluate the likelihood function. We demonstrate how Bayesian computations for such models can be drastically accelerated by r…
modelTime SeriesTime Series AnalysisVolatile Memory Motifs: Minimal Spiking Neural Networks
How spiking neuronal networks encode memories in their different time and spatial scales constitute a fundamental topic in neuroscience and neuro-inspired engineering. Much attention has been paid to large networks and l…