paper-with-me

홈 › Papers

Adaptive Robust Learning using Latent Bernoulli Variables

2023-12-01 · Aleksandr Karakulev, Dave Zachariah, Prashant Singh

We present an adaptive approach for robust learning from corrupted training sets. We identify corrupted and non-corrupted samples with latent Bernoulli variables and thus formulate the learning problem as maximization of the likelihood where latent variables are marginalized. The resulting problem is solved via variational inference, using an efficient Expectation-Maximization based method. The proposed approach improves over the state-of-the-art by automatically inferring the corruption level, while adding minimal computational overhead. We demonstrate our robust learning method and its parameter-free nature on a wide variety of machine learning tasks including online learning and deep learning where it adapts to different levels of noise and maintains high prediction accuracy.

📄 PDF Abstract BibTeX arXiv:2312.00585

Code (1)

akarakulev/rlvi 공식 구현 pytorch

Tasks

Variational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Dirichlet-Bernoulli Alignment: A Generative Model for Multi-Class Multi-Label Multi-Instance Corpora

2009-12-01 · NeurIPS 2009 12 · Shuang-Hong Yang, Hongyuan Zha, Bao-Gang Hu

We propose Dirichlet-Bernoulli Alignment (DBA), a generative model for corpora in which each pattern (e.g., a document) contains a set of instances (e.g., paragraphs in the document) and belongs to multiple classes. By c…

ClassificationEntity DisambiguationGeneral Classificationtext-classification+1

Bayesian Beta-Bernoulli Process Sparse Coding with Deep Neural Networks

2023-03-14 · Arunesh Mittal, Kai Yang, Paul Sajda, John Paisley

Several approximate inference methods have been proposed for deep discrete latent variable models. However, non-parametric methods which have previously been successfully employed for classical sparse coding models have …

Zero-inflation in the Multivariate Poisson Lognormal Family

2024-05-23 · Bastien Batardière, Julien Chiquet, François Gindraud, Mahendra Mariadassou

Analyzing high-dimensional count data is a challenge and statistical model-based approaches provide an adequate and efficient framework that preserves explainability. The (multivariate) Poisson-Log-Normal (PLN) model is …

Variational Inference

Multivariate Bernoulli distribution

2012-06-08 · Bin Dai, Shilin Ding, Grace Wahba

In this paper, we consider the multivariate Bernoulli distribution as a model to estimate the structure of graphs with binary nodes. This distribution is discussed in the framework of the exponential family, and its stat…

Variable Selection

Training Variational Auto Encoders with Discrete Latent Representations using Importance Sampling

2019-05-01 · ICLR 2019 5 · Alexander Bartler, Felix Wiewel, Bin Yang, Lukas Mauch

The Variational Auto Encoder (VAE) is a popular generative latent variable model that is often applied for representation learning. Standard VAEs assume continuous valued latent variables and are trained by maximizati…

Representation Learning