paper-with-me

Papers

Calibration of ordinal regression networks

2024-10-21 · Daehwan Kim, Haejun Chung, Ikbeom Jang

Recent studies have shown that deep neural networks are not well-calibrated and often produce over-confident predictions. The miscalibration issue primarily stems from using cross-entropy in classifications, which aims to align predicted softmax probabilities with one-hot labels. In ordinal regression tasks, this problem is compounded by an additional challenge: the expectation that softmax probabilities should exhibit unimodal distribution is not met with cross-entropy. The ordinal regression literature has focused on learning orders and overlooked calibration. To address both issues, we propose a novel loss function that introduces order-aware calibration, ensuring that prediction confidence adheres to ordinal relationships between classes. It incorporates soft ordinal encoding and order-aware regularization to enforce both calibration and unimodality. Extensive experiments across three popular ordinal regression benchmarks demonstrate that our approach achieves state-of-the-art calibration without compromising accuracy.

📄 PDF Abstract BibTeX arXiv:2410.15658

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Deep Neural Networks with Ordinal Loss for Medical Applications

2026-06-24 · Tal Dvora, Rotem Haba, Gonen Singer arxiv

In many prediction problems in medical applications, target labels exhibit an inherent ordinal structure, where class ordering reflects clinically meaningful severity levels. The cost associated with misclassification is…

GRCF: Two-Stage Groupwise Ranking and Calibration Framework for Multimodal Sentiment Analysis

2026-01-14 · Manning Gao, Leheng Zhang, Shiqin Han, Haifeng Hu 외 arxiv

Most Multimodal Sentiment Analysis research has focused on point-wise regression. While straightforward, this approach is sensitive to label noise and neglects whether one sample is more positive than another, resulting …

Multimodal Sentiment AnalysisSarcasm DetectionHumor Detection

Convolutional Ordinal Regression Forest for Image Ordinal Estimation

2020-08-07 · Haiping Zhu, Hongming Shan, Yuheng Zhang, Lingfu Che 외

Image ordinal estimation is to predict the ordinal label of a given image, which can be categorized as an ordinal regression problem. Recent methods formulate an ordinal regression problem as a series of binary classific…

Age EstimationBinary Classificationregression

Robust Deep Ordinal Regression Under Label Noise

2019-12-07 · Bhanu Garg, Naresh Manwani

The real-world data is often susceptible to label noise, which might constrict the effectiveness of the existing state of the art algorithms for ordinal regression. Existing works on ordinal regression do not take label …

regression

Ord2Seq: Regarding Ordinal Regression as Label Sequence Prediction

2023-07-18 · ICCV 2023 1 · Jinhong Wang, Yi Cheng, Jintai Chen, Tingting Chen 외

Ordinal regression refers to classifying object instances into ordinal categories. It has been widely studied in many scenarios, such as medical disease grading, movie rating, etc. Known methods focused only on learning …

Binary ClassificationPredictionregression