Variational Inference for Discriminative Learning with Generative Modeling of Feature Incompletion
We are concerned with the problem of distributional prediction with incomplete features: The goal is to estimate the distribution of target variables given feature vectors with some of the elements missing. A typical approach to this problem is to perform missing-value imputation and regression, simultaneously or sequentially, which we call the generative approach. Another approach is to perform regression after appropriately encoding missing values into the feature, which we call the discriminative approach. In comparison, the generative approach is more robust to the feature corruption while the discriminative approach is more favorable to maximize the performance of prediction. In this study, we propose a hybrid method to take the best of both worlds. Our method utilizes the black-box variational inference framework so that it can be applied to a wide variety of modern machine learning models, including the variational autoencoders. We also confirmed the effectiveness of the proposed method empirically.
Code (0)
등록된 구현이 없습니다.
Tasks
ImputationMissing ValuesregressionVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Generative Parser with a Discriminative Recognition Algorithm
Generative models defining joint distributions over parse trees and sentences are useful for parsing and language modeling, but impose restrictions on the scope of features and are often outperformed by discriminative mo…
Constituency ParsingDecoderLanguage ModelingLanguage Modelling+1Towards Unsupervised Classification with Deep Generative Models
Deep generative models have advanced the state-of-the-art in semi-supervised classification, however their capacity for deriving useful discriminative features in a completely unsupervised fashion for classification in d…
ClassificationClusteringGeneral ClassificationProbabilistic Discriminative Learning with Layered Graphical Models
Probabilistic graphical models are traditionally known for their successes in generative modeling. In this work, we advocate layered graphical models (LGMs) for probabilistic discriminative learning. To this end, we desi…
General Classificationimage-classificationImage ClassificationVariational InferenceSemi-supervised Neural Chord Estimation Based on a Variational Autoencoder with Latent Chord Labels and Features
This paper describes a statistically-principled semi-supervised method of automatic chord estimation (ACE) that can make effective use of music signals regardless of the availability of chord annotations. The typical app…
General ClassificationVariational InferenceVCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word Representations for Improved Definition Modeling
In this paper, we tackle the task of definition modeling, where the goal is to learn to generate definitions of words and phrases. Existing approaches for this task are discriminative, combining distributional and lexica…
Variational InferenceWord Embeddings