paper-with-me

Papers

Identifiable Bayesian Deep Generative Copulas with Unknown Layer Widths for Data with Arbitrary Marginal Distributions

2026-05-26 · Joseph Feldman, Yuqi Gu arxiv

Deep generative models offer powerful tools for multivariate data analysis, but their black-box architectures are often unidentified and difficult to interpret. We introduce the Deep Discrete Encoder (DDE) Copula, an identifiable and interpretable generative model for multivariate data with arbitrary marginal distributions. The model places a hierarchical directed network of binary latent variables inside a copula framework, enabling flexible dependence modeling for mixed discrete and continuous data. Estimation is based on rank likelihoods, which decouple marginal modeling from posterior inference on the DDE parameters and avoid specifying the marginal distributions. We establish conditions for identification of the DDE copula parameters, ensuring that layer-specific parameters provide meaningful summaries of multivariate dependence. We also prove quotient-space posterior consistency for continuous margins under the exact rank likelihood and treat the extended rank likelihood for tied or mixed margins as a generalized likelihood, with concentration under an additional contrast condition. For computation, we propose a stochastic expectation-maximization algorithm for \emph{maximum a posteriori} estimation, together with initialization strategies that improve convergence. To learn network dimension adaptively, we extend Bayesian rank-selection priors to infer layer-specific widths. Simulations show strong finite-sample performance, and a personality-survey analysis reveals interpretable hierarchical latent structure in complex multivariate data.

📄 PDF Abstract BibTeX arXiv:2605.27523

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Bayesian Free Energy of Deep ReLU Neural Network in Overparametrized Cases

2023-03-28 · Shuya Nagayasu, Sumio Watanabe

In many research fields in artificial intelligence, it has been shown that deep neural networks are useful to estimate unknown functions on high dimensional input spaces. However, their generalization performance is not …

Learning Theory

An Efficient Quasi-Random Sampling for Copulas

2024-03-08 · Sumin Wang, Chenxian Huang, Yongdao Zhou, Min-Qian Liu

This paper examines an efficient method for quasi-random sampling of copulas in Monte Carlo computations. Traditional methods, like conditional distribution methods (CDM), have limitations when dealing with high-dimensio…

Management

Deep Archimedean Copulas

2020-12-05 · NeurIPS 2020 12 · Chun Kai Ling, Fei Fang, J. Zico Kolter

A central problem in machine learning and statistics is to model joint densities of random variables from data. Copulas are joint cumulative distribution functions with uniform marginal distributions and are used to capt…

Generative Archimedean Copulas

2021-02-22 · Yuting Ng, Ali Hasan, Khalil Elkhalil, Vahid Tarokh

We propose a new generative modeling technique for learning multidimensional cumulative distribution functions (CDFs) in the form of copulas. Specifically, we consider certain classes of copulas known as Archimedean and …

Computational Efficiency

Implicit Generative Copulas

2021-09-29 · NeurIPS 2021 12 · Tim Janke, Mohamed Ghanmi, Florian Steinke

Copulas are a powerful tool for modeling multivariate distributions as they allow to separately estimate the univariate marginal distributions and the joint dependency structure. However, known parametric copulas offer l…

Image Generation