Variational Autoencoded Regression: High Dimensional Regression of Visual Data on Complex Manifold
This paper proposes a new high dimensional regression method by merging Gaussian process regression into a variational autoencoder framework. In contrast to other regression methods, the proposed method focuses on the case where output responses are on a complex high dimensional manifold, such as images. Our contributions are summarized as follows: (i) A new regression method estimating high dimensional image responses, which is not handled by existing regression algorithms, is proposed. (ii) The proposed regression method introduces a strategy to learn the latent space as well as the encoder and decoder so that the result of the regressed response in the latent space coincide with the corresponding response in the data space. (iii) The proposed regression is embedded into a generative model, and the whole procedure is developed by the variational autoencoder framework. We demonstrate the robustness and effectiveness of our method through a number of experiments on various visual data regression problems.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Variational empirical Bayes variable selection in high-dimensional logistic regression
Logistic regression involving high-dimensional covariates is a practically important problem. Often the goal is variable selection, i.e., determining which few of the many covariates are associated with the binary respon…
regressionVariable SelectionVariational Inference for Mahalanobis Distance Metrics in Gaussian Process Regression
We introduce a novel variational method that allows to approximately integrate out kernel hyperparameters, such as length-scales, in Gaussian process regression. This approach consists of a novel variant of the variation…
regressionVariational InferenceA variational Bayes approach to debiased inference for low-dimensional parameters in high-dimensional linear regression
We propose a scalable variational Bayes method for statistical inference for a single or low-dimensional subset of the coordinates of a high-dimensional parameter in sparse linear regression. Our approach relies on assig…
Uncertainty QuantificationVariational Inference in high-dimensional linear regression
We study high-dimensional Bayesian linear regression with product priors. Using the nascent theory of non-linear large deviations (Chatterjee and Dembo,2016), we derive sufficient conditions for the leading-order correct…
regressionVariational InferenceVocal Bursts Intensity PredictionA Mean Field Approach to Empirical Bayes Estimation in High-dimensional Linear Regression
We study empirical Bayes estimation in high-dimensional linear regression. To facilitate computationally efficient estimation of the underlying prior, we adopt a variational empirical Bayes approach, introduced originall…
Bayesian Inferenceregression