Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective
Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however, often has uncertainty and poor explainability in applications. Furthermore, neural networks themselves are often vulnerable to adversarial attacks. For those reasons, there is a high demand for trustworthy and rigorous methods to verify the robustness of neural network models. Adversarial robustness, which concerns the reliability of a neural network when dealing with maliciously manipulated inputs, is one of the hottest topics in security and machine learning. In this work, we survey existing literature in adversarial robustness verification for neural networks and collect 39 diversified research works across machine learning, security, and software engineering domains. We systematically analyze their approaches, including how robustness is formulated, what verification techniques are used, and the strengths and limitations of each technique. We provide a taxonomy from a formal verification perspective for a comprehensive understanding of this topic. We classify the existing techniques based on property specification, problem reduction, and reasoning strategies. We also demonstrate representative techniques that have been applied in existing studies with a sample model. Finally, we discuss open questions for future research.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial RobustnessBIG-bench Machine LearningMalware DetectionSimilar Papers 제목 키워드 기반
Evaluating the Robustness of Nearest Neighbor Classifiers: A Primal-Dual Perspective
We study the problem of computing the minimum adversarial perturbation of the Nearest Neighbor (NN) classifiers. Previous attempts either conduct attacks on continuous approximations of NN models or search for the pertur…
validOpportunities and Challenges in Deep Learning Adversarial Robustness: A Survey
As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reli…
Adversarial RobustnessBIG-bench Machine LearningDeep LearningSurveyFormal Verification of Deep Neural Networks for Object Detection
Deep neural networks (DNNs) are widely used in real-world applications, yet they remain vulnerable to errors and adversarial attacks. Formal verification offers a systematic approach to identify and mitigate these vulner…
image-classificationImage ClassificationObjectobject-detection+1Towards Practical Robustness Analysis for DNNs based on PAC-Model Learning
To analyse local robustness properties of deep neural networks (DNNs), we present a practical framework from a model learning perspective. Based on black-box model learning with scenario optimisation, we abstract the loc…
Adversarial AttackDNN TestingEvaluating robustness of support vector machines with the Lagrangian dual approach
Adversarial examples bring a considerable security threat to support vector machines (SVMs), especially those used in safety-critical applications. Thus, robustness verification is an essential issue for SVMs, which can …
Adversarial Robustness