Attack Strength vs. Detectability Dilemma in Adversarial Machine Learning
As the prevalence and everyday use of machine learning algorithms, along with our reliance on these algorithms grow dramatically, so do the efforts to attack and undermine these algorithms with malicious intent, resulting in a growing interest in adversarial machine learning. A number of approaches have been developed that can render a machine learning algorithm ineffective through poisoning or other types of attacks. Most attack algorithms typically use sophisticated optimization approaches, whose objective function is designed to cause maximum damage with respect to accuracy and performance of the algorithm with respect to some task. In this effort, we show that while such an objective function is indeed brutally effective in causing maximum damage on an embedded feature selection task, it often results in an attack mechanism that can be easily detected with an embarrassingly simple novelty or outlier detection algorithm. We then propose an equally simple yet elegant solution by adding a regularization term to the attacker's objective function that penalizes outlying attack points.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine Learningfeature selectionOutlier DetectionSimilar Papers 제목 키워드 기반
Illusory Attacks: Information-Theoretic Detectability Matters in Adversarial Attacks
Autonomous agents deployed in the real world need to be robust against adversarial attacks on sensory inputs. Robustifying agent policies requires anticipating the strongest attacks possible. We demonstrate that existing…
Adversarial AttackAdversarial RobustnessBalancing detectability and performance of attacks on the control channel of Markov Decision Processes
We investigate the problem of designing optimal stealthy poisoning attacks on the control channel of Markov decision processes (MDPs). This research is motivated by the recent interest of the research community for adver…
Reinforcement Learning (RL)Improving Generalizability and Undetectability for Targeted Adversarial Attacks on Multimodal Pre-trained Models
Multimodal pre-trained models (e.g., ImageBind), which align distinct data modalities into a shared embedding space, have shown remarkable success across downstream tasks. However, their increasing adoption raises seriou…
Anomaly DetectionAdv-Diffusion: Imperceptible Adversarial Face Identity Attack via Latent Diffusion Model
Adversarial attacks involve adding perturbations to the source image to cause misclassification by the target model, which demonstrates the potential of attacking face recognition models. Existing adversarial face image …
Image GenerationWaterSearch: Exploring Seed Pooling for Improving the Quality-Detectability Trade-off in LLM Watermarking
Watermarking acts as a critical safeguard in text generated by Large Language Models (LLMs). By embedding identifiable signals into model outputs, watermarking enables reliable attribution and enhances the security of ma…
Text Generation