Stabilizing Invertible Neural Networks Using Mixture Models
In this paper, we analyze the properties of invertible neural networks, which provide a way of solving inverse problems. Our main focus lies on investigating and controlling the Lipschitz constants of the corresponding inverse networks. Without such an control, numerical simulations are prone to errors and not much is gained against traditional approaches. Fortunately, our analysis indicates that changing the latent distribution from a standard normal one to a Gaussian mixture model resolves the issue of exploding Lipschitz constants. Indeed, numerical simulations confirm that this modification leads to significantly improved sampling quality in multimodal applications.
Code (1)
Similar Papers 제목 키워드 기반
Learning Control for LQR with Unknown Packet Loss Rate Using Finite Channel Samples
This paper studies the linear quadratic regulator (LQR) problem over an unknown Bernoulli packet loss channel. The unknown loss rate is estimated using finite channel samples and a certainty-equivalence (CE) optimal cont…
Invertible Neural Networks for Graph Prediction
Graph prediction problems prevail in data analysis and machine learning. The inverse prediction problem, namely to infer input data from given output labels, is of emerging interest in various applications. In this work,…
Anomaly DetectionGraph Neural NetworkPredictionSurvival Mixture Density Networks
Survival analysis, the art of time-to-event modeling, plays an important role in clinical treatment decisions. Recently, continuous time models built from neural ODEs have been proposed for survival analysis. However, th…
Survival AnalysisOptimal output feedback control of a class of linear systems with quasi-colored control-dependent multiplicative noise
This paper addresses the mean-square optimal control problem for \a class of discrete-time linear systems with a quasi-colored control-dependent multiplicative noise via output feedback. The noise under study is novel an…
Self-Asymmetric Invertible Network for Compression-Aware Image Rescaling
High-resolution (HR) images are usually downscaled to low-resolution (LR) ones for better display and afterward upscaled back to the original size to recover details. Recent work in image rescaling formulates downscaling…
Image CompressionImage Rescaling