Killing four birds with one Gaussian process: the relation between different test-time attacks
In machine learning (ML) security, attacks like evasion, model stealing or membership inference are generally studied in individually. Previous work has also shown a relationship between some attacks and decision function curvature of the targeted model. Consequently, we study an ML model allowing direct control over the decision surface curvature: Gaussian Process classifiers (GPCs). For evasion, we find that changing GPC's curvature to be robust against one attack algorithm boils down to enabling a different norm or attack algorithm to succeed. This is backed up by our formal analysis showing that static security guarantees are opposed to learning. Concerning intellectual property, we show formally that lazy learning does not necessarily leak all information when applied. In practice, often a seemingly secure curvature can be found. For example, we are able to secure GPC against empirical membership inference by proper configuration. In this configuration, however, the GPC's hyper-parameters are leaked, e.g. model reverse engineering succeeds. We conclude that attacks on classification should not be studied in isolation, but in relation to each other.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationRelationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Killing Four Birds with Two Stones: Multi-Task Learning for Non-Literal Language Detection
Non-literal language phenomena such as idioms or metaphors are commonly studied in isolation from each other in NLP. However, often similar definitions and features are being used for different phenomena, challenging the…
General ClassificationMulti-Task LearningAphids, Ants and Ladybirds: a mathematical model predicting their population dynamics
The interaction between aphids, ants and ladybirds has been investigated from an ecological point of view since many decades, while there are no attempts to describe it from a mathematical point of view. This paper intro…
Time Series AnalysisTwo Birds, One Stone: Jointly Learning Binary Code for Large-Scale Face Image Retrieval and Attributes Prediction
We address the challenging large-scale content-based face image retrieval problem, intended as searching images based on the presence of specific subject, given one face image of him/her. To this end, one natural demand …
Face Image RetrievalImage RetrievalRetrievalKilling Two Birds with One Stone: Quantization Achieves Privacy in Distributed Learning
Communication efficiency and privacy protection are two critical issues in distributed machine learning. Existing methods tackle these two issues separately and may have a high implementation complexity that constrains t…
QuantizationLeveraging Habitat Information for Fine-grained Bird Identification
Traditional bird classifiers mostly rely on the visual characteristics of birds. Some prior works even train classifiers to be invariant to the background, completely discarding the living environment of birds. Instead, …
Image Augmentation