paper-with-me

홈 › Papers

Advancing Neural Network Verification through Hierarchical Safety Abstract Interpretation

2025-05-08 · Luca Marzari, Isabella Mastroeni, Alessandro Farinelli

Traditional methods for formal verification (FV) of deep neural networks (DNNs) are constrained by a binary encoding of safety properties, where a model is classified as either safe or unsafe (robust or not robust). This binary encoding fails to capture the nuanced safety levels within a model, often resulting in either overly restrictive or too permissive requirements. In this paper, we introduce a novel problem formulation called Abstract DNN-Verification, which verifies a hierarchical structure of unsafe outputs, providing a more granular analysis of the safety aspect for a given DNN. Crucially, by leveraging abstract interpretation and reasoning about output reachable sets, our approach enables assessing multiple safety levels during the FV process, requiring the same (in the worst case) or even potentially less computational effort than the traditional binary verification approach. Specifically, we demonstrate how this formulation allows rank adversarial inputs according to their abstract safety level violation, offering a more detailed evaluation of the model's safety and robustness. Our contributions include a theoretical exploration of the relationship between our novel abstract safety formulation and existing approaches that employ abstract interpretation for robustness verification, complexity analysis of the novel problem introduced, and an empirical evaluation considering both a complex deep reinforcement learning task (based on Habitat 3.0) and standard DNN-Verification benchmarks.

📄 PDF Abstract BibTeX arXiv:2505.05235

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Similar Papers 제목 키워드 기반

Formal Verification of Learned Multi-Agent Communication Policies via Decision Tree Distillation

2026-06-17 · Ahmad Farooq, Kamran Iqbal arxiv

Multi-agent reinforcement learning (MARL) enables agents to develop coordination strategies through emergent communication, but neural policies lack the formal safety guarantees required for safety-critical robotic deplo…

Multi-agent Reinforcement Learning

Analyzing Deep Neural Networks with Symbolic Propagation: Towards Higher Precision and Faster Verification

2019-02-26 · Jianlin Li, Pengfei Yang, Jiangchao Liu, Liqian Chen 외

Deep neural networks (DNNs) have been shown lack of robustness for the vulnerability of their classification to small perturbations on the inputs. This has led to safety concerns of applying DNNs to safety-critical domai…

An Abstraction-based Method to Check Multi-Agent Deep Reinforcement-Learning Behaviors

2021-02-02 · Pierre El Mqirmi, Francesco Belardinelli, Borja G. León

Multi-agent reinforcement learning (RL) often struggles to ensure the safe behaviours of the learning agents, and therefore it is generally not adapted to safety-critical applications. To address this issue, we present a…

Deep Reinforcement LearningMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Safety Verification of Unknown Dynamical Systems via Gaussian Process Regression

2020-06-15

The deployment of autonomous systems that operate in unstructured environments necessitates algorithms to verify their safety. This can be challenging due to, e.g., black-box components in the control software, or underm…

Gaussian Processesregression

Continuous Safety Verification of Neural Networks

2020-10-12 · Chih-Hong Cheng, Rongjie Yan

Deploying deep neural networks (DNNs) as core functions in autonomous driving creates unique verification and validation challenges. In particular, the continuous engineering paradigm of gradually perfecting a DNN-based …

Autonomous Drivingvalid