paper-with-me

홈 › Papers

Quantitative Verification of Neural Networks And its Security Applications

2019-06-25 · Teodora Baluta, Shiqi Shen, Shweta Shinde, Kuldeep S. Meel, Prateek Saxena

Neural networks are increasingly employed in safety-critical domains. This has prompted interest in verifying or certifying logically encoded properties of neural networks. Prior work has largely focused on checking existential properties, wherein the goal is to check whether there exists any input that violates a given property of interest. However, neural network training is a stochastic process, and many questions arising in their analysis require probabilistic and quantitative reasoning, i.e., estimating how many inputs satisfy a given property. To this end, our paper proposes a novel and principled framework to quantitative verification of logical properties specified over neural networks. Our framework is the first to provide PAC-style soundness guarantees, in that its quantitative estimates are within a controllable and bounded error from the true count. We instantiate our algorithmic framework by building a prototype tool called NPAQ that enables checking rich properties over binarized neural networks. We show how emerging security analyses can utilize our framework in 3 concrete point applications: quantifying robustness to adversarial inputs, efficacy of trojan attacks, and fairness/bias of given neural networks.

📄 PDF Abstract BibTeX arXiv:1906.10395

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Similar Papers 제목 키워드 기반

Explainable Face Verification via Feature-Guided Gradient Backpropagation

2024-03-07 · Yuhang Lu, Zewei Xu, Touradj Ebrahimi

Recent years have witnessed significant advancement in face recognition (FR) techniques, with their applications widely spread in people's lives and security-sensitive areas. There is a growing need for reliable interpre…

Face RecognitionFace Verification

AutoBaxBuilder: Bootstrapping Code Security Benchmarking

2025-12-24 · Tobias von Arx, Niels Mündler, Mark Vero, Maximilian Baader 외 arxiv

As large language models (LLMs) see wide adoption in software engineering, the reliable assessment of the correctness and security of LLM-generated code is crucial. Notably, prior work showed that LLMs are prone to gener…

SoK: Explainable Machine Learning for Computer Security Applications

2022-08-22 · Azqa Nadeem, Daniël Vos, Clinton Cao, Luca Pajola 외

Explainable Artificial Intelligence (XAI) aims to improve the transparency of machine learning (ML) pipelines. We systematize the increasingly growing (but fragmented) microcosm of studies that develop and utilize XAI me…

Computer SecurityExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Verification of Neural Networks: Enhancing Scalability through Pruning

2020-03-17 · Dario Guidotti, Francesco Leofante, Luca Pulina, Armando Tacchella

Verification of deep neural networks has witnessed a recent surge of interest, fueled by success stories in diverse domains and by abreast concerns about safety and security in envisaged applications. Complexity and shee…

Network Pruning

Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective

2022-06-24 · Mark Huasong Meng, Guangdong Bai, Sin Gee Teo, Zhe Hou 외

Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however, often has uncertainty and poor explainab…

Adversarial RobustnessBIG-bench Machine LearningMalware Detection