paper-with-me

Papers

Multiclass Boosting: Simple and Intuitive Weak Learning Criteria

2023-07-02 · NeurIPS 2023 11

We study a generalization of boosting to the multiclass setting. We introduce a weak learning condition for multiclass classification that captures the original notion of weak learnability as being "slightly better than random guessing". We give a simple and efficient boosting algorithm, that does not require realizability assumptions and its sample and oracle complexity bounds are independent of the number of classes. In addition, we utilize our new boosting technique in several theoretical applications within the context of List PAC Learning. First, we establish an equivalence to weak PAC learning. Furthermore, we present a new result on boosting for list learners, as well as provide a novel proof for the characterization of multiclass PAC learning and List PAC learning. Notably, our technique gives rise to a simplified analysis, and also implies an improved error bound for large list sizes, compared to previous results.

📄 PDF Abstract BibTeX arXiv:2307.00642

Code (0)

등록된 구현이 없습니다.

Tasks

PAC learning

Similar Papers 제목 키워드 기반

Online Agnostic Multiclass Boosting

2022-05-30 · Vinod Raman, Ambuj Tewari

Boosting is a fundamental approach in machine learning that enjoys both strong theoretical and practical guarantees. At a high-level, boosting algorithms cleverly aggregate weak learners to generate predictions with arbi…

Binary Classification

Online Multiclass Boosting

2017-02-23 · NeurIPS 2017 12 · Young Hun Jung, Jack Goetz, Ambuj Tewari

Recent work has extended the theoretical analysis of boosting algorithms to multiclass problems and to online settings. However, the multiclass extension is in the batch setting and the online extensions only consider bi…

Binary ClassificationGeneral Classification

Multiclass Boosting and the Cost of Weak Learning

2021-12-01 · NeurIPS 2021 12 · Nataly Brukhim, Elad Hazan, Shay Moran, Indraneel Mukherjee 외

Boosting is an algorithmic approach which is based on the idea of combining weak and moderately inaccurate hypotheses to a strong and accurate one. In this work we study multiclass boosting with a possibly large …

Online Multiclass Boosting with Bandit Feedback

2018-10-11 · Daniel T. Zhang, Young Hun Jung, Ambuj Tewari

We present online boosting algorithms for multiclass classification with bandit feedback, where the learner only receives feedback about the correctness of its prediction. We propose an unbiased estimate of the loss usin…

General Classification

Multiclass Boosting: Theory and Algorithms

2011-12-01 · NeurIPS 2011 12 · Mohammad J. Saberian, Nuno Vasconcelos

The problem of multiclass boosting is considered. A new framework,based on multi-dimensional codewords and predictors is introduced. The optimal set of codewords is derived, and a margin enforcing loss proposed. The res…