paper-with-me

홈 › Papers

A Multiclass Boosting Framework for Achieving Fast and Provable Adversarial Robustness

2021-03-01 · Jacob Abernethy, Pranjal Awasthi, Satyen Kale

Alongside the well-publicized accomplishments of deep neural networks there has emerged an apparent bug in their success on tasks such as object recognition: with deep models trained using vanilla methods, input images can be slightly corrupted in order to modify output predictions, even when these corruptions are practically invisible. This apparent lack of robustness has led researchers to propose methods that can help to prevent an adversary from having such capabilities. The state-of-the-art approaches have incorporated the robustness requirement into the loss function, and the training process involves taking stochastic gradient descent steps not using original inputs but on adversarially-corrupted ones. In this paper we propose a multiclass boosting framework to ensure adversarial robustness. Boosting algorithms are generally well-suited for adversarial scenarios, as they were classically designed to satisfy a minimax guarantee. We provide a theoretical foundation for this methodology and describe conditions under which robustness can be achieved given a weak training oracle. We show empirically that adversarially-robust multiclass boosting not only outperforms the state-of-the-art methods, it does so at a fraction of the training time.

📄 PDF Abstract BibTeX arXiv:2103.01276

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial RobustnessObject Recognition

Similar Papers 제목 키워드 기반

Efficient Methods for Online Multiclass Logistic Regression

2021-10-06 · Naman Agarwal, Satyen Kale, Julian Zimmert

Multiclass logistic regression is a fundamental task in machine learning with applications in classification and boosting. Previous work (Foster et al., 2018) has highlighted the importance of improper predictors for ach…

regression

Multi-Resolution Cascades for Multiclass Object Detection

2014-12-01 · NeurIPS 2014 12 · Mohammad Saberian, Nuno Vasconcelos

An algorithm for learning fast multiclass object detection cascades is introduced. It produces multi-resolution (MRes) cascades, whose early stages are binary target vs. non-target detectors that eliminate false positive…

Objectobject-detectionObject Detection

Compact Multi-Class Boosted Trees

2017-10-31 · Natalia Ponomareva, Thomas Colthurst, Gilbert Hendry, Salem Haykal 외

Gradient boosted decision trees are a popular machine learning technique, in part because of their ability to give good accuracy with small models. We describe two extensions to the standard tree boosting algorithm desig…

Factorized MultiClass Boosting

2019-09-11 · Igor E. Kuralenok, Yurii Rebryk, Ruslan Solovev, Anton Ermilov

In this paper, we introduce a new approach to multiclass classification problem. We decompose the problem into a series of regression tasks, that are solved with CART trees. The proposed method works significantly faster…

General Classificationregression

Online Multiclass Boosting

2017-02-23 · NeurIPS 2017 12 · Young Hun Jung, Jack Goetz, Ambuj Tewari

Recent work has extended the theoretical analysis of boosting algorithms to multiclass problems and to online settings. However, the multiclass extension is in the batch setting and the online extensions only consider bi…

Binary ClassificationGeneral Classification