Gradient estimators for normalising flows
Recently a machine learning approach to Monte-Carlo simulations called Neural Markov Chain Monte-Carlo (NMCMC) is gaining traction. In its most popular form it uses neural networks to construct normalizing flows which are then trained to approximate the desired target distribution. In this contribution we present new gradient estimator for Stochastic Gradient Descent algorithm (and the corresponding \texttt{PyTorch} implementation) and show that it leads to better training results for $\phi^4$ model. For this model our estimator achieves the same precision in approximately half of the time needed in standard approach and ultimately provides better estimates of the free energy. We attribute this effect to the lower variance of the new estimator. In contrary to the standard learning algorithm our approach does not require estimation of the action gradient with respect to the fields, thus has potential of further speeding up the training for models with more complicated actions.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeNormalising FlowsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Conditional Density Estimation with Bayesian Normalising Flows
Modeling complex conditional distributions is critical in a variety of settings. Despite a long tradition of research into conditional density estimation, current methods employ either simple parametric forms or are diff…
Density EstimationNormalising FlowsRelaxing Bijectivity Constraints with Continuously Indexed Normalising Flows
We show that normalising flows become pathological when used to model targets whose supports have complicated topologies. In this scenario, we prove that a flow must become arbitrarily numerically noninvertible in order …
Density EstimationNormalising FlowsConformalised Conditional Normalising Flows for Joint Prediction Regions in time series
Conformal Prediction offers a powerful framework for quantifying uncertainty in machine learning models, enabling the construction of prediction sets with finite-sample validity guarantees. While easily adaptable to non-…
Conformal PredictionNormalising FlowsPredictionTime Series+1Latent Transformations for Discrete-Data Normalising Flows
Normalising flows (NFs) for discrete data are challenging because parameterising bijective transformations of discrete variables requires predicting discrete/integer parameters. Having a neural network architecture predi…
Normalising FlowsRobust model training and generalisation with Studentising flows
Normalising flows are tractable probabilistic models that leverage the power of deep learning to describe a wide parametric family of distributions, all while remaining trainable using maximum likelihood. We discuss how …
modelNormalising Flows