Probabilistic Deep Ordinal Regression Based on Gaussian Processes
With excellent representation power for complex data, deep neural networks (DNNs) based approaches are state-of-the-art for ordinal regression problem which aims to classify instances into ordinal categories. However, DNNs are not able to capture uncertainties and produce probabilistic interpretations. As a probabilistic model, Gaussian Processes (GPs) on the other hand offers uncertainty information, which is nonetheless lack of scalability for large datasets. This paper adapts traditional GPs regression for ordinal regression problem by using both conjugate and non-conjugate ordinal likelihood. Based on that, it proposes a deep neural network with a GPs layer on the top, which is trained end-to-end by the stochastic gradient descent method for both neural network parameters and GPs parameters. The parameters in the ordinal likelihood function are learned as neural network parameters so that the proposed framework is able to produce fitted likelihood functions for training sets and make probabilistic predictions for test points. Experimental results on three real-world benchmarks -- image aesthetics rating, historical image grading and age group estimation -- demonstrate that in terms of mean absolute error, the proposed approach outperforms state-of-the-art ordinal regression approaches and provides the confidence for predictions.
Code (0)
등록된 구현이 없습니다.
Tasks
Age And Gender ClassificationAge EstimationGaussian ProcessesHistorical Color Image DatingregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regression
Uncertainty is the only certainty there is. Modeling data uncertainty is essential for regression, especially in unconstrained settings. Traditionally the direct regression formulation is considered and the uncertainty i…
Aesthetics Quality AssessmentAge And Gender ClassificationAge EstimationHistorical Color Image Dating+1Fast Bayesian Inference for Non-Conjugate Gaussian Process Regression
We present a new variational inference algorithm for Gaussian processes with non-conjugate likelihood functions. This includes binary and multi-class classification, as well as ordinal regression. Our method constructs a…
Bayesian InferenceGaussian ProcessesGeneral ClassificationMulti-class Classification+2A unified framework for closed-form nonparametric regression, classification, preference and mixed problems with Skew Gaussian Processes
Skew-Gaussian processes (SkewGPs) extend the multivariate Unified Skew-Normal distributions over finite dimensional vectors to distribution over functions. SkewGPs are more general and flexible than Gaussian processes, a…
Active LearningBinary ClassificationFormGaussian Processes+1Deep Gaussian Processes for Regression using Approximate Expectation Propagation
Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are nonparametric …
Gaussian ProcessesregressionProstate Tissue Grading with Deep Quantum Measurement Ordinal Regression
Prostate cancer (PCa) is one of the most common and aggressive cancers worldwide. The Gleason score (GS) system is the standard way of classifying prostate cancer and the most reliable method to determine the severity an…
Binary ClassificationClassificationGeneral ClassificationOrdinal Classification+3