ROOM: Adversarial Machine Learning Attacks Under Real-Time Constraints
Advances in deep learning have enabled a wide range of promising applications. However, these systems are vulnerable to Adversarial Machine Learning (AML) attacks; adversarially crafted perturbations to their inputs could cause them to misclassify. Several state-of-the-art adversarial attacks have demonstrated that they can reliably fool classifiers making these attacks a significant threat. Adversarial attack generation algorithms focus primarily on creating successful examples while controlling the noise magnitude and distribution to make detection more difficult. The underlying assumption of these attacks is that the adversarial noise is generated offline, making their execution time a secondary consideration. However, recently, just-in-time adversarial attacks where an attacker opportunistically generates adversarial examples on the fly have been shown to be possible. This paper introduces a new problem: how do we generate adversarial noise under real-time constraints to support such real-time adversarial attacks? Understanding this problem improves our understanding of the threat these attacks pose to real-time systems and provides security evaluation benchmarks for future defenses. Therefore, we first conduct a run-time analysis of adversarial generation algorithms. Universal attacks produce a general attack offline, with no online overhead, and can be applied to any input; however, their success rate is limited because of their generality. In contrast, online algorithms, which work on a specific input, are computationally expensive, making them inappropriate for operation under time constraints. Thus, we propose ROOM, a novel Real-time Online-Offline attack construction Model where an offline component serves to warm up the online algorithm, making it possible to generate highly successful attacks under time constraints.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial AttackBIG-bench Machine LearningSimilar Papers 제목 키워드 기반
Benchmarking Robustness of Machine Reading Comprehension Models
Machine Reading Comprehension (MRC) is an important testbed for evaluating models' natural language understanding (NLU) ability. There has been rapid progress in this area, with new models achieving impressive performanc…
BenchmarkingMachine Reading ComprehensionNatural Language UnderstandingReading ComprehensionFortify Machine Learning Production Systems: Detect and Classify Adversarial Attacks
Production machine learning systems are consistently under attack by adversarial actors. Various deep learning models must be capable of accurately detecting fake or adversarial input while maintaining speed. In this wor…
Adversarial AttackBIG-bench Machine Learningimage-classificationImage Classification+1On The Empirical Effectiveness of Unrealistic Adversarial Hardening Against Realistic Adversarial Attacks
While the literature on security attacks and defense of Machine Learning (ML) systems mostly focuses on unrealistic adversarial examples, recent research has raised concern about the under-explored field of realistic adv…
Adversarial RobustnessMalware Detectiontext-classificationText ClassificationAdversarial Purification for Data-Driven Power System Event Classifiers with Diffusion Models
The global deployment of the phasor measurement units (PMUs) enables real-time monitoring of the power system, which has stimulated considerable research into machine learning-based models for event detection and classif…
Adversarial PurificationComputational EfficiencyEvent DetectionMachine and Deep Learning for Indoor UWB Jammer Localization
Ultra-wideband (UWB) localization delivers centimeter-scale accuracy but is vulnerable to jamming attacks, creating security risks for asset tracking and intrusion detection in smart buildings. Although machine learning …
Intrusion DetectionTransfer Learning