Learning Non-linear Wavelet Transformation via Normalizing Flow
Wavelet transformation stands as a cornerstone in modern data analysis and signal processing. Its mathematical essence is an invertible transformation that discerns slow patterns from fast ones in the frequency domain. Such an invertible transformation can be learned by a designed normalizing flow model. With a generalized lifting scheme as coupling layers, a factor-out layer resembling the downsampling, and parameter sharing at different levels of the model, one can train the normalizing flow to filter high-frequency elements at different levels, thus extending traditional linear wavelet transformations to learnable non-linear deep learning models. In this paper, a way of building such flow is proposed, along with a numerical analysis of the learned transformation. Then, we demonstrate the model's ability in image lossless compression, show it can achieve SOTA compression scores while achieving a small model size, substantial generalization ability, and the ability to handle high-dimensional data.
Code (1)
Tasks
Super-ResolutionSimilar Papers 제목 키워드 기반
Wavelet Flow: Fast Training of High Resolution Normalizing Flows
Normalizing flows are a class of probabilistic generative models which allow for both fast density computation and efficient sampling and are effective at modelling complex distributions like images. A drawback among cur…
GPUSuper-ResolutionVocal Bursts Intensity PredictionHaar Wavelet based Block Autoregressive Flows for Trajectories
Prediction of trajectories such as that of pedestrians is crucial to the performance of autonomous agents. While previous works have leveraged conditional generative models like GANs and VAEs for learning the likely futu…
Enhancing Low-resolution Image Representation Through Normalizing Flows
Low-resolution image representation can be regarded as a special form of sparse representation that retains only low-frequency information while discarding high-frequency components. This property reduces storage and tra…
Image RescalingMulti-Scale Continuous Normalizing Flows
We introduce a multi-scale variant of Continuous Normalizing Flows, and explore the computation of likelihood values. We also introduce a Wavelet-version of the model. However, we find that this formulation is flawed in …
AUTM Flow: Atomic Unrestricted Time Machine for Monotonic Normalizing Flows
Nonlinear monotone transformations are used extensively in normalizing flows to construct invertible triangular mappings from simple distributions to complex ones. In existing literature, monotonicity is usually enforced…
Density EstimationImage GenerationVariational Inference