paper-with-me

Papers

Gradient estimators for normalising flows

2022-02-02 · Piotr Bialas, Piotr Korcyl, Tomasz Stebel

Recently a machine learning approach to Monte-Carlo simulations called Neural Markov Chain Monte-Carlo (NMCMC) is gaining traction. In its most popular form it uses neural networks to construct normalizing flows which are then trained to approximate the desired target distribution. In this contribution we present new gradient estimator for Stochastic Gradient Descent algorithm (and the corresponding \texttt{PyTorch} implementation) and show that it leads to better training results for $\phi^4$ model. For this model our estimator achieves the same precision in approximately half of the time needed in standard approach and ultimately provides better estimates of the free energy. We attribute this effect to the lower variance of the new estimator. In contrary to the standard learning algorithm our approach does not require estimation of the action gradient with respect to the fields, thus has potential of further speeding up the training for models with more complicated actions.

📄 PDF Abstract BibTeX arXiv:2202.01314

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeNormalising Flows

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Conditional Density Estimation with Bayesian Normalising Flows

2018-02-14 · Brian L. Trippe, Richard E. Turner

Modeling complex conditional distributions is critical in a variety of settings. Despite a long tradition of research into conditional density estimation, current methods employ either simple parametric forms or are diff…

Density EstimationNormalising Flows

Relaxing Bijectivity Constraints with Continuously Indexed Normalising Flows

2019-09-30 · ICML 2020 1 · Rob Cornish, Anthony L. Caterini, George Deligiannidis, Arnaud Doucet

We show that normalising flows become pathological when used to model targets whose supports have complicated topologies. In this scenario, we prove that a flow must become arbitrarily numerically noninvertible in order …

Density EstimationNormalising Flows

Conformalised Conditional Normalising Flows for Joint Prediction Regions in time series

2024-11-26 · Eshant English, Christoph Lippert

Conformal Prediction offers a powerful framework for quantifying uncertainty in machine learning models, enabling the construction of prediction sets with finite-sample validity guarantees. While easily adaptable to non-…

Conformal PredictionNormalising FlowsPredictionTime Series+1

Latent Transformations for Discrete-Data Normalising Flows

2020-06-11 · Rob Hesselink, Wilker Aziz

Normalising flows (NFs) for discrete data are challenging because parameterising bijective transformations of discrete variables requires predicting discrete/integer parameters. Having a neural network architecture predi…

Normalising Flows

Robust model training and generalisation with Studentising flows

2020-06-11 · Simon Alexanderson, Gustav Eje Henter

Normalising flows are tractable probabilistic models that leverage the power of deep learning to describe a wide parametric family of distributions, all while remaining trainable using maximum likelihood. We discuss how …

modelNormalising Flows