Improving Deep Regression with Ordinal Entropy
In computer vision, it is often observed that formulating regression problems as a classification task often yields better performance. We investigate this curious phenomenon and provide a derivation to show that classification, with the cross-entropy loss, outperforms regression with a mean squared error loss in its ability to learn high-entropy feature representations. Based on the analysis, we propose an ordinal entropy loss to encourage higher-entropy feature spaces while maintaining ordinal relationships to improve the performance of regression tasks. Experiments on synthetic and real-world regression tasks demonstrate the importance and benefits of increasing entropy for regression.
Code (1)
Tasks
ClassificationCrowd CountingDepth EstimationMonocular Depth EstimationregressionSimilar Papers 제목 키워드 기반
Calibration of ordinal regression networks
Recent studies have shown that deep neural networks are not well-calibrated and often produce over-confident predictions. The miscalibration issue primarily stems from using cross-entropy in classifications, which aims t…
regressionClass Distance Weighted Cross-Entropy Loss for Ulcerative Colitis Severity Estimation
In scoring systems used to measure the endoscopic activity of ulcerative colitis, such as Mayo endoscopic score or Ulcerative Colitis Endoscopic Index Severity, levels increase with severity of the disease activity. Such…
Image ClassificationregressionDeep Neural Networks with Ordinal Loss for Medical Applications
In many prediction problems in medical applications, target labels exhibit an inherent ordinal structure, where class ordering reflects clinically meaningful severity levels. The cost associated with misclassification is…
Meta ordinal weighting net for improving lung nodule classification
The progression of lung cancer implies the intrinsic ordinal relationship of lung nodules at different stages-from benign to unsure then to malignant. This problem can be solved by ordinal regression methods, which is be…
ClassificationGeneral ClassificationLung Nodule ClassificationMeta-Learning+1Rank consistent ordinal regression for neural networks with application to age estimation
In many real-world prediction tasks, class labels include information about the relative ordering between labels, which is not captured by commonly-used loss functions such as multi-category cross-entropy. Recently, the …
Age And Gender ClassificationAge EstimationBinary ClassificationGender Prediction+3