paper-with-me

Papers

Multiobjective Optimization of Classifiers by Means of 3-D Convex Hull Based Evolutionary Algorithm

2014-12-18 · Jiaqi Zhao, Vitor Basto Fernandes, Licheng Jiao, Iryna Yevseyeva, Asep Maulana, Rui Li, Thomas Bäck, Michael T. M. Emmerich

Finding a good classifier is a multiobjective optimization problem with different error rates and the costs to be minimized. The receiver operating characteristic is widely used in the machine learning community to analyze the performance of parametric classifiers or sets of Pareto optimal classifiers. In order to directly compare two sets of classifiers the area (or volume) under the convex hull can be used as a scalar indicator for the performance of a set of classifiers in receiver operating characteristic space. Recently, the convex hull based multiobjective genetic programming algorithm was proposed and successfully applied to maximize the convex hull area for binary classification problems. The contribution of this paper is to extend this algorithm for dealing with higher dimensional problem formulations. In particular, we discuss problems where parsimony (or classifier complexity) is stated as a third objective and multi-class classification with three different true classification rates to be maximized. The design of the algorithm proposed in this paper is inspired by indicator-based evolutionary algorithms, where first a performance indicator for a solution set is established and then a selection operator is designed that complies with the performance indicator. In this case, the performance indicator will be the volume under the convex hull. The algorithm is tested and analyzed in a proof of concept study on different benchmarks that are designed for measuring its capability to capture relevant parts of a convex hull. Further benchmark and application studies on email classification and feature selection round up the analysis and assess robustness and usefulness of the new algorithm in real world settings.

📄 PDF Abstract BibTeX arXiv:1412.5710

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationClassificationEvolutionary Algorithmsfeature selectionGeneral ClassificationMulti-class ClassificationMultiobjective Optimization

Similar Papers 제목 키워드 기반

Convex Hull Monte-Carlo Tree Search

2020-03-09 · Michael Painter, Bruno Lacerda, Nick Hawes

This work investigates Monte-Carlo planning for agents in stochastic environments, with multiple objectives. We propose the Convex Hull Monte-Carlo Tree-Search (CHMCTS) framework, which builds upon Trial Based Heuristic …

Multi-Armed Bandits

P-split formulations: A class of intermediate formulations between big-M and convex hull for disjunctive constraints

2022-02-10 · Jan Kronqvist, Ruth Misener, Calvin Tsay

We develop a class of mixed-integer formulations for disjunctive constraints intermediate to the big-M and convex hull formulations in terms of relaxation strength. The main idea is to capture the best of both the big-M …

Clustering

Between steps: Intermediate relaxations between big-M and convex hull formulations

2021-01-29 · Jan Kronqvist, Ruth Misener, Calvin Tsay

This work develops a class of relaxations in between the big-M and convex hull formulations of disjunctions, drawing advantages from both. The proposed "P-split" formulations split convex additively separable constraints…

ClusteringForm

The Hybridization of Branch and Bound with Metaheuristics for Nonconvex Multiobjective Optimization

2022-12-09 · Wei-tian Wu, Xin-min Yang

A hybrid framework combining the branch and bound method with multiobjective evolutionary algorithms is proposed for nonconvex multiobjective optimization. The hybridization exploits the complementary character of the tw…

Evolutionary AlgorithmsMultiobjective Optimization

Active Learning of Classifiers with Label and Seed Queries

2022-09-08 · Marco Bressan, Nicolò Cesa-Bianchi, Silvio Lattanzi, Andrea Paudice 외

We study exact active learning of binary and multiclass classifiers with margin. Given an $n$-point set $X \subset \mathbb{R}^m$, we want to learn any unknown classifier on $X$ whose classes have finite strong convex hul…

Active Learning