ADABORD: a novel AdaBoost approach for ordinal classification
Ordinal Classification (OC) deals with classification tasks where the classes follow a natural order. Despite the progress in OC, many existing approaches fail to fully leverage the ordinal information, treating the problem as nominal classification and thereby losing performance potential. In this work, ADABORD, an AdaBoost framework specifically designed for ordinal classification problems, is introduced. The ordinal nature of the classes is incorporated into two key components of the well-known AdaBoost algorithm: 1) the base estimator, where decision trees with the ordinal Gini splitting criterion are proposed; 2) the error function used to update sample weights at each stage and the weights of the classifier in the final ensemble model, given by the absolute ranked probability score, a measure that accounts for both the ordering and the distance between classes. ADABORD is extensively compared against seven state-of-the-art methods on the TOC-UCO repository, the largest benchmark collection for OC to date. The experimental results, supported by statistical analysis, show that ADABORD significantly outperforms competing methods, particularly on datasets with five or more classes, where the ordinal structure becomes more pronounced. Source code, along with all experimental protocols, is publicly available to ensure reproducibility and facilitate future research in OC.
Code (0)
등록된 구현이 없습니다.
Tasks
Ordinal ClassificationSimilar Papers 제목 키워드 기반
oAdaBoost: An AdaBoost Variant for Ordinal Classification
Ordinal data classification (ODC) has a wide range of applications in areas where human evaluation plays an important role, ranging from psychology and medicine to information retrieval. In ODC the output variable has a…
ClassificationGeneral ClassificationInformation RetrievalMulti-Label Classification+2Re-scale AdaBoost for Attack Detection in Collaborative Filtering Recommender Systems
Collaborative filtering recommender systems (CFRSs) are the key components of successful e-commerce systems. Actually, CFRSs are highly vulnerable to attacks since its openness. However, since attack size is far smaller …
Collaborative FilteringGeneral Classificationimbalanced classificationRecommendation SystemsAdaptive Boosting with Fairness-aware Reweighting Technique for Fair Classification
Machine learning methods based on AdaBoost have been widely applied to various classification problems across many mission-critical applications including healthcare, law and finance. However, there is a growing concern …
Binary ClassificationClassificationFairnessFace Detection Using Adaboosted SVM-Based Component Classifier
Recently, Adaboost has been widely used to improve the accuracy of any given learning algorithm. In this paper we focus on designing an algorithm to employ combination of Adaboost with Support Vector Machine as weak comp…
Face DetectionGeneral Classificationimbalanced classificationdlordinal: a Python package for deep ordinal classification
dlordinal is a new Python library that unifies many recent deep ordinal classification methodologies available in the literature. Developed using PyTorch as underlying framework, it implements the top performing state-of…
ClassificationOrdinal Classification