paper-with-me

Papers

Deep Neural Network Ensembles against Deception: Ensemble Diversity, Accuracy and Robustness

2019-08-29 · Ling Liu, Wenqi Wei, Ka-Ho Chow, Margaret Loper, Emre Gursoy, Stacey Truex, Yanzhao Wu

Ensemble learning is a methodology that integrates multiple DNN learners for improving prediction performance of individual learners. Diversity is greater when the errors of the ensemble prediction is more uniformly distributed. Greater diversity is highly correlated with the increase in ensemble accuracy. Another attractive property of diversity optimized ensemble learning is its robustness against deception: an adversarial perturbation attack can mislead one DNN model to misclassify but may not fool other ensemble DNN members consistently. In this paper we first give an overview of the concept of ensemble diversity and examine the three types of ensemble diversity in the context of DNN classifiers. We then describe a set of ensemble diversity measures, a suite of algorithms for creating diversity ensembles and for performing ensemble consensus (voted or learned) for generating high accuracy ensemble output by strategically combining outputs of individual members. This paper concludes with a discussion on a set of open issues in quantifying ensemble diversity for robust deep learning.

📄 PDF Abstract BibTeX arXiv:1908.11091

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityEnsemble Learning

Similar Papers 제목 키워드 기반

Robust Deep Learning Ensemble against Deception

2020-09-14 · Wenqi Wei, Ling Liu

Deep neural network (DNN) models are known to be vulnerable to maliciously crafted adversarial examples and to out-of-distribution inputs drawn sufficiently far away from the training data. How to protect a machine learn…

Adversarial RobustnessDeep LearningDenoisingDiversity+1

Neural Ensemble Search for Uncertainty Estimation and Dataset Shift

2020-06-15 · NeurIPS 2021 12 · Sheheryar Zaidi, Arber Zela, Thomas Elsken, Chris Holmes 외

Ensembles of neural networks achieve superior performance compared to stand-alone networks in terms of accuracy, uncertainty calibration and robustness to dataset shift. \emph{Deep ensembles}, a state-of-the-art method f…

AutoMLDiversityImage ClassificationNeural Architecture Search

Improved Robustness Against Adaptive Attacks With Ensembles and Error-Correcting Output Codes

2023-03-04 · Thomas Philippon, Christian Gagné

Neural network ensembles have been studied extensively in the context of adversarial robustness and most ensemble-based approaches remain vulnerable to adaptive attacks. In this paper, we investigate the robustness of Er…

Adversarial RobustnessDiversity

Deep Ensembles with Hierarchical Diversity Pruning

2021-01-01 · Yanzhao Wu, Ling Liu

Diverse deep ensembles hold the potential for improving accuracy and robustness of deep learning models. Both pairwise and non-pairwise ensemble diversity metrics have been proposed over the past two decades. However, it…

Diversity

Promoting High Diversity Ensemble Learning with EnsembleBench

2020-10-20 · Yanzhao Wu, Ling Liu, Zhongwei Xie, Juhyun Bae 외

Ensemble learning is gaining renewed interests in recent years. This paper presents EnsembleBench, a holistic framework for evaluating and recommending high diversity and high accuracy ensembles. The design of EnsembleBe…

BenchmarkingDiversityEnsemble LearningVocal Bursts Intensity Prediction