Rank consistent ordinal regression for neural networks with application to age estimation
In many real-world prediction tasks, class labels include information about the relative ordering between labels, which is not captured by commonly-used loss functions such as multi-category cross-entropy. Recently, the deep learning community adopted ordinal regression frameworks to take such ordering information into account. Neural networks were equipped with ordinal regression capabilities by transforming ordinal targets into binary classification subtasks. However, this method suffers from inconsistencies among the different binary classifiers. To resolve these inconsistencies, we propose the COnsistent RAnk Logits (CORAL) framework with strong theoretical guarantees for rank-monotonicity and consistent confidence scores. Moreover, the proposed method is architecture-agnostic and can extend arbitrary state-of-the-art deep neural network classifiers for ordinal regression tasks. The empirical evaluation of the proposed rank-consistent method on a range of face-image datasets for age prediction shows a substantial reduction of the prediction error compared to the reference ordinal regression network.
Code (4)
Tasks
Age And Gender ClassificationAge EstimationBinary ClassificationGender PredictionGeneral ClassificationPredictionregressionSimilar Papers 제목 키워드 기반
Contrastive Order Learning: A General Framework for Ordinal Regression
We propose contrastive order learning (ConOrd), a contrastive learning framework for ordinal regression that integrates the strengths of contrastive learning and order learning. While contrastive learning effectively lev…
Image Quality AssessmentVideo Quality AssessmentContrastive LearningAge EstimationRobust Deep Ordinal Regression Under Label Noise
The real-world data is often susceptible to label noise, which might constrict the effectiveness of the existing state of the art algorithms for ordinal regression. Existing works on ordinal regression do not take label …
regressionDeep Neural Networks for Rank-Consistent Ordinal Regression Based On Conditional Probabilities
In recent times, deep neural networks achieved outstanding predictive performance on various classification and pattern recognition tasks. However, many real-world prediction problems have ordinal response variables, and…
regressionUniversally Rank Consistent Ordinal Regression in Neural Networks
Despite the pervasiveness of ordinal labels in supervised learning, it remains common practice in deep learning to treat such problems as categorical classification using the categorical cross entropy loss. Recent method…
Binary ClassificationPrognosisregressionOrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regression
This paper presents a language-powered paradigm for ordinal regression. Existing methods usually treat each rank as a category and employ a set of weights to learn these concepts. These methods are easy to overfit and us…
Aesthetics Quality AssessmentAge EstimationFew-shot Age EstimationHistorical Color Image Dating+3