paper-with-me

홈 › Papers

Learning Continuous Exponential Families Beyond Gaussian

2021-02-18 · Christopher X. Ren, Sidhant Misra, Marc Vuffray, Andrey Y. Lokhov

We address the problem of learning of continuous exponential family distributions with unbounded support. While a lot of progress has been made on learning of Gaussian graphical models, we still lack scalable algorithms for reconstructing general continuous exponential families modeling higher-order moments of the data beyond the mean and the covariance. Here, we introduce a computationally efficient method for learning continuous graphical models based on the Interaction Screening approach. Through a series of numerical experiments, we show that our estimator maintains similar requirements in terms of accuracy and sample complexity scalings compared to alternative approaches such as maximization of conditional likelihood, while considerably improving upon the algorithm's run-time.

📄 PDF Abstract BibTeX arXiv:2102.09198

Code (1)

lanl-ansi/isodus 공식 구현

Similar Papers 제목 키워드 기반

Kernel Deformed Exponential Families for Sparse Continuous Attention

2021-11-01 · Alexander Moreno, Supriya Nagesh, Zhenke Wu, Walter Dempsey 외

Attention mechanisms take an expectation of a data representation with respect to probability weights. This creates summary statistics that focus on important features. Recently, (Martins et al. 2020, 2021) proposed cont…

Sparse Continuous Distributions and Fenchel-Young Losses

2021-08-04 · André F. T. Martins, Marcos Treviso, António Farinhas, Pedro M. Q. Aguiar 외

Exponential families are widely used in machine learning, including many distributions in continuous and discrete domains (e.g., Gaussian, Dirichlet, Poisson, and categorical distributions via the softmax transformation)…

Audio ClassificationQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Sparse and Continuous Attention Mechanisms

2020-06-12 · NeurIPS 2020 12 · André F. T. Martins, António Farinhas, Marcos Treviso, Vlad Niculae 외

Exponential families are widely used in machine learning; they include many distributions in continuous and discrete domains (e.g., Gaussian, Dirichlet, Poisson, and categorical distributions via the softmax transformati…

Machine TranslationQuestion Answeringtext-classificationText Classification+3

Beyond Sub-Gaussian Measurements: High-Dimensional Structured Estimation with Sub-Exponential Designs

2015-12-01 · NeurIPS 2015 12 · Vidyashankar Sivakumar, Arindam Banerjee, Pradeep K. Ravikumar

We consider the problem of high-dimensional structured estimation with norm-regularized estimators, such as Lasso, when the design matrix and noise are drawn from sub-exponential distributions.Existing results only consi…

Vocal Bursts Intensity Prediction

VAE Approximation Error: ELBO and Exponential Families

2021-02-18 · ICLR 2022 4 · Alexander Shekhovtsov, Dmitrij Schlesinger, Boris Flach

The importance of Variational Autoencoders reaches far beyond standalone generative models -- the approach is also used for learning latent representations and can be generalized to semi-supervised learning. This require…

Decoder