Deep and interpretable regression models for ordinal outcomes
Outcomes with a natural order commonly occur in prediction tasks and often the available input data are a mixture of complex data like images and tabular predictors. Deep Learning (DL) models are state-of-the-art for image classification tasks but frequently treat ordinal outcomes as unordered and lack interpretability. In contrast, classical ordinal regression models consider the outcome's order and yield interpretable predictor effects but are limited to tabular data. We present ordinal neural network transformation models (ONTRAMs), which unite DL with classical ordinal regression approaches. ONTRAMs are a special case of transformation models and trade off flexibility and interpretability by additively decomposing the transformation function into terms for image and tabular data using jointly trained neural networks. The performance of the most flexible ONTRAM is by definition equivalent to a standard multi-class DL model trained with cross-entropy while being faster in training when facing ordinal outcomes. Lastly, we discuss how to interpret model components for both tabular and image data on two publicly available datasets.
Code (1)
Tasks
image-classificationImage ClassificationregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
bqror: An R package for Bayesian Quantile Regression in Ordinal Models
This article describes an R package bqror that estimates Bayesian quantile regression for ordinal models introduced in Rahman (2016). The paper classifies ordinal models into two types and offers computationally efficien…
quantile regressionregressionOrdinal Regression using Noisy Pairwise Comparisons for Body Mass Index Range Estimation
Ordinal regression aims to classify instances into ordinal categories. In this paper, body mass index (BMI) category estimation from facial images is cast as an ordinal regression problem. In particular, noisy binary sea…
General ClassificationregressionAutoScore-Ordinal: An interpretable machine learning framework for generating scoring models for ordinal outcomes
Background: Risk prediction models are useful tools in clinical decision-making which help with risk stratification and resource allocations and may lead to a better health care for patients. AutoScore is a machine learn…
Decision MakingInterpretable Machine LearningModel SelectionPrediction+1Ordinal-ResLogit: Interpretable Deep Residual Neural Networks for Ordered Choices
This study presents an Ordinal version of Residual Logit (Ordinal-ResLogit) model to investigate the ordinal responses. We integrate the standard ResLogit model into COnsistent RAnk Logits (CORAL) framework, classified a…
Binary ClassificationregressionAn interpretable neural network-based non-proportional odds model for ordinal regression
This study proposes an interpretable neural network-based non-proportional odds model (N$^3$POM) for ordinal regression. N$^3$POM is different from conventional approaches to ordinal regression with non-proportional mode…
regression