Robust Image Ordinal Regression with Controllable Image Generation
Image ordinal regression has been mainly studied along the line of exploiting the order of categories. However, the issues of class imbalance and category overlap that are very common in ordinal regression were largely overlooked. As a result, the performance on minority categories is often unsatisfactory. In this paper, we propose a novel framework called CIG based on controllable image generation to directly tackle these two issues. Our main idea is to generate extra training samples with specific labels near category boundaries, and the sample generation is biased toward the less-represented categories. To achieve controllable image generation, we seek to separate structural and categorical information of images based on structural similarity, categorical similarity, and reconstruction constraints. We evaluate the effectiveness of our new CIG approach in three different image ordinal regression scenarios. The results demonstrate that CIG can be flexibly integrated with off-the-shelf image encoders or ordinal regression models to achieve improvement, and further, the improvement is more significant for minority categories.
Code (1)
Tasks
Image GenerationregressionSimilar Papers 제목 키워드 기반
Convolutional Ordinal Regression Forest for Image Ordinal Estimation
Image ordinal estimation is to predict the ordinal label of a given image, which can be categorized as an ordinal regression problem. Recent methods formulate an ordinal regression problem as a series of binary classific…
Age EstimationBinary ClassificationregressionTeach CLIP to Develop a Number Sense for Ordinal Regression
Ordinal regression is a fundamental problem within the field of computer vision, with customised well-trained models on specific tasks. While pre-trained vision-language models (VLMs) have exhibited impressive performanc…
regressionText MatchingDual-level Fuzzy Learning with Patch Guidance for Image Ordinal Regression
Ordinal regression bridges regression and classification by assigning objects to ordered classes. While human experts rely on discriminative patch-level features for decisions, current approaches are limited by the avail…
regressionDeep and interpretable regression models for ordinal outcomes
Outcomes with a natural order commonly occur in prediction tasks and often the available input data are a mixture of complex data like images and tabular predictors. Deep Learning (DL) models are state-of-the-art for ima…
image-classificationImage ClassificationregressionProbabilistic Deep Ordinal Regression Based on Gaussian Processes
With excellent representation power for complex data, deep neural networks (DNNs) based approaches are state-of-the-art for ordinal regression problem which aims to classify instances into ordinal categories. However, DN…
Age And Gender ClassificationAge EstimationGaussian ProcessesHistorical Color Image Dating+1