Semi-supervised Regression using Hessian energy with an application to semi-supervised dimensionality reduction
Semi-supervised regression based on the graph Laplacian suffers from the fact that the solution is biased towards a constant and the lack of extrapolating power. Outgoing from these observations we propose to use the second-order Hessian energy for semi-supervised regression which overcomes both of these problems, in particular, if the data lies on or close to a low-dimensional submanifold in the feature space, the Hessian energy prefers functions which vary ``linearly with respect to the natural parameters in the data. This property makes it also particularly suited for the task of semi-supervised dimensionality reduction where the goal is to find the natural parameters in the data based on a few labeled points. The experimental result suggest that our method is superior to semi-supervised regression using Laplacian regularization and standard supervised methods and is particularly suited for semi-supervised dimensionality reduction.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionregressionSupervised dimensionality reductionSimilar Papers 제목 키워드 기반
Multiview Hessian regularized logistic regression for action recognition
With the rapid development of social media sharing, people often need to manage the growing volume of multimedia data such as large scale video classification and annotation, especially to organize those videos containin…
Action RecognitionAttributeGeneral Classificationregression+2Measuring Complexity of Learning Schemes Using Hessian-Schatten Total Variation
In this paper, we introduce the Hessian-Schatten total variation (HTV) -- a novel seminorm that quantifies the total "rugosity" of multivariate functions. Our motivation for defining HTV is to assess the complexity of su…
Image ReconstructionSemi-supervised Fréchet Regression
This paper explores the field of semi-supervised Fr\'echet regression, driven by the significant costs associated with obtaining non-Euclidean labels. Methodologically, we propose two novel methods: semi-supervised NW Fr…
regressionGeneralizing semi-supervised generative adversarial networks to regression using feature contrasting
In this work, we generalize semi-supervised generative adversarial networks (GANs) from classification problems to regression problems. In the last few years, the importance of improving the training of neural networks u…
Age EstimationCrowd CountingGeneral ClassificationregressionSemi-supervised teacher-student deep neural network for materials discovery
Data driven generative machine learning models have recently emerged as one of the most promising approaches for new materials discovery. While the generator models can generate millions of candidates, it is critical to …
Formation Energyregression