paper-with-me

Papers

Feature Partitioning for Robust Tree Ensembles and their Certification in Adversarial Scenarios

2020-04-07 · Stefano Calzavara, Claudio Lucchese, Federico Marcuzzi, Salvatore Orlando

Machine learning algorithms, however effective, are known to be vulnerable in adversarial scenarios where a malicious user may inject manipulated instances. In this work we focus on evasion attacks, where a model is trained in a safe environment and exposed to attacks at test time. The attacker aims at finding a minimal perturbation of a test instance that changes the model outcome. We propose a model-agnostic strategy that builds a robust ensemble by training its basic models on feature-based partitions of the given dataset. Our algorithm guarantees that the majority of the models in the ensemble cannot be affected by the attacker. We experimented the proposed strategy on decision tree ensembles, and we also propose an approximate certification method for tree ensembles that efficiently assess the minimal accuracy of a forest on a given dataset avoiding the costly computation of evasion attacks. Experimental evaluation on publicly available datasets shows that proposed strategy outperforms state-of-the-art adversarial learning algorithms against evasion attacks.

📄 PDF Abstract BibTeX arXiv:2004.03295

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Subspace Learning Machine (SLM): Methodology and Performance

2022-05-11 · Hongyu Fu, Yijing Yang, Vinod K. Mishra, C. -C. Jay Kuo

Inspired by the feedforward multilayer perceptron (FF-MLP), decision tree (DT) and extreme learning machine (ELM), a new classification model, called the subspace learning machine (SLM), is proposed in this work. SLM fir…

Benchmarking

Yggdrasil: An Optimized System for Training Deep Decision Trees at Scale

2016-12-01 · NeurIPS 2016 12 · Firas Abuzaid, Joseph K. Bradley, Feynman T. Liang, Andrew Feng 외

Deep distributed decision trees and tree ensembles have grown in importance due to the need to model increasingly large datasets. However, PLANET, the standard distributed tree learning algorithm implemented in systems …

CPU

Exact Certification of Neural Networks and Partition Aggregation Ensembles against Label Poisoning

2026-04-13 · Ajinkya Mohgaonkar, Lukas Gosch, Mahalakshmi Sabanayagam, Debarghya Ghoshdastidar 외 arxiv

Label-flipping attacks, which corrupt training labels to induce misclassifications at inference, remain a major threat to supervised learning models. This drives the need for robustness certificates that provide formal g…

A Unified Approach to Extract Interpretable Rules from Tree Ensembles via Integer Programming

2024-06-30 · Lorenzo Bonasera, Emilio Carrizosa

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees,…

regressionTime Series

Evolutionary algorithms for constructing an ensemble of decision trees

2020-02-03 · Evgeny Dolotov, Nikolai Zolotykh

Most decision tree induction algorithms are based on a greedy top-down recursive partitioning strategy for tree growth. In this paper, we propose several methods for induction of decision trees and their ensembles based …

Evolutionary Algorithmsreinforcement-learningReinforcement LearningReinforcement Learning (RL)