paper-with-me

홈 › Papers

Class Binarization to NeuroEvolution for Multiclass Classification

2023-08-26 · Gongjin Lan, Zhenyu Gao, Lingyao Tong, Ting Liu

Multiclass classification is a fundamental and challenging task in machine learning. The existing techniques of multiclass classification can be categorized as (i) decomposition into binary (ii) extension from binary and (iii) hierarchical classification. Decomposing multiclass classification into a set of binary classifications that can be efficiently solved by using binary classifiers, called class binarization, which is a popular technique for multiclass classification. Neuroevolution, a general and powerful technique for evolving the structure and weights of neural networks, has been successfully applied to binary classification. In this paper, we apply class binarization techniques to a neuroevolution algorithm, NeuroEvolution of Augmenting Topologies (NEAT), that is used to generate neural networks for multiclass classification. We propose a new method that applies Error-Correcting Output Codes (ECOC) to design the class binarization strategies on the neuroevolution for multiclass classification. The ECOC strategies are compared with the class binarization strategies of One-vs-One and One-vs-All on three well-known datasets Digit, Satellite, and Ecoli. We analyse their performance from four aspects of multiclass classification degradation, accuracy, evolutionary efficiency, and robustness. The results show that the NEAT with ECOC performs high accuracy with low variance. Specifically, it shows significant benefits in a flexible number of binary classifiers and strong robustness.

📄 PDF Abstract BibTeX arXiv:2308.13876

Code (1)

lafengxiaoyu/neat-ensembles 공식 구현

Tasks

BinarizationBinary ClassificationClassification

Methods 이 논문이 사용한 방법론

NEAT 설명 없음

Similar Papers 제목 키워드 기반

Radar-based Feature Design and Multiclass Classification for Road User Recognition

2019-05-27 · Nicolas Scheiner, Nils Appenrodt, Jürgen Dickmann, Bernhard Sick

The classification of individual traffic participants is a complex task, especially for challenging scenarios with multiple road users or under bad weather conditions. Radar sensors provide an - with respect to well esta…

BinarizationClassificationGeneral Classification

Neuroevolutionary algorithms driven by neuron coverage metrics for semi-supervised classification

2023-03-05 · Roberto Santana, Ivan Hidalgo-Cenalmor, Unai Garciarena, Alexander Mendiburu 외

In some machine learning applications the availability of labeled instances for supervised classification is limited while unlabeled instances are abundant. Semi-supervised learning algorithms deal with these scenarios a…

Unified Binary and Multiclass Margin-Based Classification

2023-11-29 · Yutong Wang, Clayton Scott

The notion of margin loss has been central to the development and analysis of algorithms for binary classification. To date, however, there remains no consensus as to the analogue of the margin loss for multiclass classi…

Binary ClassificationClassificationForm

Classification Calibration Dimension for General Multiclass Losses

2012-12-01 · NeurIPS 2012 12 · Harish G. Ramaswamy, Shivani Agarwal

We study consistency properties of surrogate loss functions for general multiclass classification problems, defined by a general loss matrix. We extend the notion of classification calibration, which has been studied for…

ClassificationGeneral Classification

The Optimal Sample Complexity of Multiclass and List Learning

2026-04-27 · Chirag Pabbaraju arxiv

While the optimal sample complexity of binary classification in terms of the VC dimension is well-established, determining the optimal sample complexity of multiclass classification has remained open. The appropriate com…

Binary Classification