Preconditioned Stochastic Gradient Langevin Dynamics for Deep Neural Networks
Pytorch implementations of Bayes By Backprop, MC Dropout, SGLD, the Local Reparametrization Trick, KF-Laplace and more
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adaptively Preconditioned Stochastic Gradient Langevin Dynamics
Stochastic Gradient Langevin Dynamics infuses isotropic gradient noise to SGD to help navigate pathological curvature in the loss landscape for deep networks. Isotropic nature of the noise leads to poor scaling, and adap…
NavigateBayesian Sparse learning with preconditioned stochastic gradient MCMC and its applications
In this work, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trai…
Sparse LearningStochastic Gradient Langevin Dynamics Algorithms with Adaptive Drifts
Bayesian deep learning offers a principled way to address many issues concerning safety of artificial intelligence (AI), such as model uncertainty,model interpretability, and prediction bias. However, due to the lack of …
Deep LearningNatural Langevin Dynamics for Neural Networks
One way to avoid overfitting in machine learning is to use model parameters distributed according to a Bayesian posterior given the data, rather than the maximum likelihood estimator. Stochastic gradient Langevin dynamic…
Remote sensing image fusion based on Bayesian GAN
Remote sensing image fusion technology (pan-sharpening) is an important means to improve the information capacity of remote sensing images. Inspired by the efficient arameter space posteriori sampling of Bayesian neural …
Bayesian InferenceGenerative Adversarial NetworkImage Reconstruction