paper-with-me

Papers

Continuously Generalized Ordinal Regression for Linear and Deep Models

2022-02-14 · Fred Lu, Francis Ferraro, Edward Raff

Ordinal regression is a classification task where classes have an order and prediction error increases the further the predicted class is from the true class. The standard approach for modeling ordinal data involves fitting parallel separating hyperplanes that optimize a certain loss function. This assumption offers sample efficient learning via inductive bias, but is often too restrictive in real-world datasets where features may have varying effects across different categories. Allowing class-specific hyperplane slopes creates generalized logistic ordinal regression, increasing the flexibility of the model at a cost to sample efficiency. We explore an extension of the generalized model to the all-thresholds logistic loss and propose a regularization approach that interpolates between these two extremes. Our method, which we term continuously generalized ordinal logistic, significantly outperforms the standard ordinal logistic model over a thorough set of ordinal regression benchmark datasets. We further extend this method to deep learning and show that it achieves competitive or lower prediction error compared to previous models over a range of datasets and modalities. Furthermore, two primary alternative models for deep learning ordinal regression are shown to be special cases of our framework.

📄 PDF Abstract BibTeX arXiv:2202.07005

Code (0)

등록된 구현이 없습니다.

Tasks

Inductive Biasregression

Similar Papers 제목 키워드 기반

A generalized framework to predict continuous scores from medical ordinal labels

2023-05-30 · Katharina V. Hoebel, Andreanne Lemay, John Peter Campbell, Susan Ostmo 외

Many variables of interest in clinical medicine, like disease severity, are recorded using discrete ordinal categories such as normal/mild/moderate/severe. These labels are used to train and evaluate disease severity pre…

Multi-class ClassificationOrdinal Classificationseverity prediction

R2VF: A Two-Step Regularization Algorithm to Cluster Categories in GLMs

2025-03-03 · Yuval Ben Dror

Over recent decades, extensive research has aimed to overcome the restrictive underlying assumptions required for a Generalized Linear Model to generate accurate and meaningful predictions. These efforts include regulari…

Clustering

DFORD: Directional Feedback based Online Ordinal Regression Learning

2025-12-22 · Naresh Manwani, M Elamparithy, Tanish Taneja arxiv

In this paper, we introduce directional feedback in the ordinal regression setting, in which the learner receives feedback on whether the predicted label is on the left or the right side of the actual label. This is a we…

Contrastive Learning for Semi-Supervised Deep Regression with Generalized Ordinal Rankings from Spectral Seriation

2025-12-10 · Ce Wang, Weihang Dai, Hanru Bai, Xiaomeng Li arxiv

Contrastive learning methods enforce label distance relationships in feature space to improve representation capability for regression models. However, these methods highly depend on label information to correctly recove…

Representation LearningContrastive Learning

An interpretable neural network-based non-proportional odds model for ordinal regression

2023-03-31 · Akifumi Okuno, Kazuharu Harada

This study proposes an interpretable neural network-based non-proportional odds model (N$^3$POM) for ordinal regression. N$^3$POM is different from conventional approaches to ordinal regression with non-proportional mode…

regression