High-dimensional density estimation with tensorizing flow
We propose the tensorizing flow method for estimating high-dimensional probability density functions from the observed data. The method is based on tensor-train and flow-based generative modeling. Our method first efficiently constructs an approximate density in the tensor-train form via solving the tensor cores from a linear system based on the kernel density estimators of low-dimensional marginals. We then train a continuous-time flow model from this tensor-train density to the observed empirical distribution by performing a maximum likelihood estimation. The proposed method combines the optimization-less feature of the tensor-train with the flexibility of the flow-based generative models. Numerical results are included to demonstrate the performance of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Density EstimationVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Solving high-dimensional parameter inference: marginal posterior densities & Moment Networks
High-dimensional probability density estimation for inference suffers from the "curse of dimensionality". For many physical inference problems, the full posterior distribution is unwieldy and seldom used in practice. Ins…
Density EstimationTime SeriesTime Series AnalysisVocal Bursts Intensity PredictionNormalizing Flows for Interventional Density Estimation
Existing machine learning methods for causal inference usually estimate quantities expressed via the mean of potential outcomes (e.g., average treatment effect). However, such quantities do not capture the full informati…
Causal InferenceDensity EstimationDenoising Normalizing Flow
Normalizing flows (NF) are expressive as well as tractable density estimation methods whenever the support of the density is diffeomorphic to the entire data-space. However, real-world data sets typically live on (or ver…
DenoisingDensity EstimationOn the minimax optimality of Flow Matching through the connection to kernel density estimation
Flow Matching has recently gained attention in generative modeling as a simple and flexible alternative to diffusion models, the current state of the art. While existing statistical guarantees adapt tools from the analys…
Density EstimationConformal Embedding Flows: Tractable Density Estimation on Learned Manifolds
Normalizing flows are generative models that provide tractable density estimation by transforming a simple distribution into a complex one. However, flows cannot directly model data supported on an unknown low-dimensiona…
Density Estimation