From Counterfactuals to Trees: Competitive Analysis of Model Extraction Attacks

2025-02-07 · Awa Khouna, Julien Ferry, Thibaut Vidal

The advent of Machine Learning as a Service (MLaaS) has heightened the trade-off between model explainability and security. In particular, explainability techniques, such as counterfactual explanations, inadvertently increase the risk of model extraction attacks, enabling unauthorized replication of proprietary models. In this paper, we formalize and characterize the risks and inherent complexity of model reconstruction, focusing on the "oracle'' queries required for faithfully inferring the underlying prediction function. We present the first formal analysis of model extraction attacks through the lens of competitive analysis, establishing a foundational framework to evaluate their efficiency. Focusing on models based on additive decision trees (e.g., decision trees, gradient boosting, and random forests), we introduce novel reconstruction algorithms that achieve provably perfect fidelity while demonstrating strong anytime performance. Our framework provides theoretical bounds on the query complexity for extracting tree-based model, offering new insights into the security vulnerabilities of their deployment.

📄 PDF Abstract BibTeX arXiv:2502.05325

Code (1)

vidalt/Tree-Extractor 공식 구현

Tasks

counterfactualModel extraction

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

TrEEStealer: Stealing Decision Trees via Enclave Side Channels

2026-04-20 · Jonas Sander, Anja Rabich, Nick Mahling, Felix Maurer 외 arxiv

Today, machine learning is widely applied in sensitive, security-related, and financially lucrative applications. Model extraction attacks undermine current business models where a model owner sells model access, e.g., v…

Model extraction

Quantifying the Privacy of Counterfactuals by Leveraging Membership Inference Attacks Against Synthetic Data

2026-06-04 · Maryam Babaei, Yingke Wang, Hadrien Lautraite, Heber H. Arcolezi 외 arxiv

Counterfactuals are typically used in high-stakes decision areas to explain a machine learning model by showing how changes to the user profiles result in the desired outcome. However, explaining the model's decisions th…

Distal Explanations for Model-free Explainable Reinforcement Learning

2020-01-28 · Prashan Madumal, Tim Miller, Liz Sonenberg, Frank Vetere

In this paper we introduce and evaluate a distal explanation model for model-free reinforcement learning agents that can generate explanations for `why' and `why not' questions. Our starting point is the observation that…

model reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Differentially Private Counterfactuals via Functional Mechanism

2022-08-04 · Fan Yang, Qizhang Feng, Kaixiong Zhou, Jiahao Chen 외

Counterfactual, serving as one emerging type of model explanation, has attracted tons of attentions recently from both industry and academia. Different from the conventional feature-based explanations (e.g., attributions…

counterfactual valid

Linear Model Extraction via Factual and Counterfactual Queries

2026-02-10 · Daan Otto, Jannis Kurtz, Dick den Hertog, Ilker Birbil arxiv

In model extraction attacks, the goal is to reveal the parameters of a black-box machine learning model by querying the model for a selected set of data points. Due to an increasing demand for explanations, this may invo…