paper-with-me

Papers

Optimal-margin evolutionary classifier

2018-04-26 · Mohammad Reza Bonyadi, David C. Reutens

We introduce a novel approach for discriminative classification using evolutionary algorithms. We first propose an algorithm to optimize the total loss value using a modified 0-1 loss function in a one-dimensional space for classification. We then extend this algorithm for multi-dimensional classification using an evolutionary algorithm. The proposed evolutionary algorithm aims to find a hyperplane which best classifies instances while minimizes the classification risk. We test particle swarm optimization, evolutionary strategy, and covariance matrix adaptation evolutionary strategy for optimization purpose. Finally, we compare our results with well-established and state-of-the-art classification algorithms, for both binary and multi-class classification, on 19 benchmark classification problems, with and without noise and outliers. Results show that the performance of the proposed algorithm is significantly (t-test) better than all other methods in almost all problems tested. We also show that the proposed algorithm is significantly more robust against noise and outliers comparing to other methods. The running time of the algorithm is within a reasonable range for the solution of real-world classification problems.

📄 PDF Abstract BibTeX arXiv:1804.09891

Code (1)

rezabonyadi/LinearOEC 공식 구현

Tasks

ClassificationEvolutionary AlgorithmsGeneral ClassificationMulti-class Classification

Similar Papers 제목 키워드 기반

An Evolutionary Approach for Creating of Diverse Classifier Ensembles

2022-08-23 · Alvaro R. Ferreira Jr, Fabio A. Faria, Gustavo Carneiro, Vinicius V. de Melo

Classification is one of the most studied tasks in data mining and machine learning areas and many works in the literature have been presented to solve classification problems for multiple fields of knowledge such as med…

Classification

A Transductive Maximum Margin Classifier for Few-Shot Learning

2021-07-26 · Fei Pan, Chunlei Xu, Jie Guo, Yanwen Guo

Few-shot learning aims to train a classifier that can generalize well when just a small number of labeled examples per class are given. We introduce a transductive maximum margin classifier for few-shot learning (FS-TMMC…

Few-Shot Learning

Improved Margin Generalization Bounds for Voting Classifiers

2025-02-23 · Mikael Møller Høgsgaard, Kasper Green Larsen

In this paper we establish a new margin-based generalization bound for voting classifiers, refining existing results and yielding tighter generalization guarantees for widely used boosting algorithms such as AdaBoost (Fr…

Generalization Bounds

Optimal AdaBoost Converges

2022-10-11 · Conor Snedeker

The following work is a preprint collection of formal proofs regarding the convergence properties of the AdaBoost machine learning algorithm's classifier and margins. Various math and computer science papers have been wr…

Math

Regularized Evolutionary Algorithm for Dynamic Neural Topology Search

2019-05-15 · Cristiano Saltori, Subhankar Roy, Nicu Sebe, Giovanni Iacca

Designing neural networks for object recognition requires considerable architecture engineering. As a remedy, neuro-evolutionary network architecture search, which automatically searches for optimal network architectures…

Evolutionary AlgorithmsNeural Architecture SearchObject Recognition