paper-with-me

홈 › Papers

On multi-class learning through the minimization of the confusion matrix norm

2013-03-16 · Sokol Koço, Cécile Capponi

In imbalanced multi-class classification problems, the misclassification rate as an error measure may not be a relevant choice. Several methods have been developed where the performance measure retained richer information than the mere misclassification rate: misclassification costs, ROC-based information, etc. Following this idea of dealing with alternate measures of performance, we propose to address imbalanced classification problems by using a new measure to be optimized: the norm of the confusion matrix. Indeed, recent results show that using the norm of the confusion matrix as an error measure can be quite interesting due to the fine-grain informations contained in the matrix, especially in the case of imbalanced classes. Our first contribution then consists in showing that optimizing criterion based on the confusion matrix gives rise to a common background for cost-sensitive methods aimed at dealing with imbalanced classes learning problems. As our second contribution, we propose an extension of a recent multi-class boosting method --- namely AdaBoost.MM --- to the imbalanced class problem, by greedily minimizing the empirical norm of the confusion matrix. A theoretical analysis of the properties of the proposed method is presented, while experimental results illustrate the behavior of the algorithm and show the relevancy of the approach compared to other methods.

📄 PDF Abstract BibTeX arXiv:1303.4015

Code (0)

등록된 구현이 없습니다.

Tasks

General Classificationimbalanced classificationMulti-class Classification

Similar Papers 제목 키워드 기반

PyCM: Multiclass confusion matrix library in Python

2018-05-29 · The Journal of Open Source Software 2018 5 · Sepand Haghighi, Masoomeh Jasemi, Shaahin Hessabi, Alireza Zolanvari

PyCM is a multi-class confusion matrix library written in Python that supports both input data vectors and direct matrix, and a proper tool for post-classification model evaluation that supports most classes and overall …

General Classification

Hierarchical confusion matrix for classification performance evaluation

2023-06-15 · Kevin Riehl, Michael Neunteufel, Martin Hemberg

In this work we propose a novel concept of a hierarchical confusion matrix, opening the door for popular confusion matrix based (flat) evaluation measures from binary classification problems, while considering the peculi…

Binary ClassificationClassification

Neo: Generalizing Confusion Matrix Visualization to Hierarchical and Multi-Output Labels

2021-10-24 · Jochen Görtler, Fred Hohman, Dominik Moritz, Kanit Wongsuphasawat 외

The confusion matrix, a ubiquitous visualization for helping people evaluate machine learning models, is a tabular layout that compares predicted class labels against actual class labels over all data instances. We condu…

BIG-bench Machine Learning

PAC-Bayesian Generalization Bound on Confusion Matrix for Multi-Class Classification

2012-02-28 · Emilie Morvant, Sokol Koço, Liva Ralaivola

In this work, we propose a PAC-Bayes bound for the generalization risk of the Gibbs classifier in the multi-class classification framework. The novelty of our work is the critical use of the confusion matrix of a classif…

General ClassificationMulti-class Classification

Understanding the Essence: Delving into Annotator Prototype Learning for Multi-Class Annotation Aggregation

2025-08-04 · Ju Chen, Jun Feng, Shenyu Zhang arxiv

Multi-class classification annotations have significantly advanced AI applications, with truth inference serving as a critical technique for aggregating noisy and biased annotations. Existing state-of-the-art methods typ…

Multi-class Classification