paper-with-me

Papers

Complete Verification via Multi-Neuron Relaxation Guided Branch-and-Bound

2022-04-30 · ICLR 2022 4 · Claudio Ferrari, Mark Niklas Muller, Nikola Jovanovic, Martin Vechev

State-of-the-art neural network verifiers are fundamentally based on one of two paradigms: either encoding the whole verification problem via tight multi-neuron convex relaxations or applying a Branch-and-Bound (BaB) procedure leveraging imprecise but fast bounding methods on a large number of easier subproblems. The former can capture complex multi-neuron dependencies but sacrifices completeness due to the inherent limitations of convex relaxations. The latter enables complete verification but becomes increasingly ineffective on larger and more challenging networks. In this work, we present a novel complete verifier which combines the strengths of both paradigms: it leverages multi-neuron relaxations to drastically reduce the number of subproblems generated during the BaB process and an efficient GPU-based dual optimizer to solve the remaining ones. An extensive evaluation demonstrates that our verifier achieves a new state-of-the-art on both established benchmarks as well as networks with significantly higher accuracy than previously considered. The latter result (up to 28% certification gains) indicates meaningful progress towards creating verifiers that can handle practically relevant networks.

📄 PDF Abstract BibTeX arXiv:2205.00263

Code (1)

eth-sri/mn-bab 공식 구현 pytorch

Tasks

GPU

Similar Papers 제목 키워드 기반

Neural Network Verification using Partial Multi-Neuron Relaxation

2026-05-28 · Ido Shmuel, Guy Katz arxiv

The increasing integration of deep neural networks in critical systems has spawned a theoretical and practical interest in formally guaranteeing safety properties about their behavior. To achieve this, contemporary verif…

On the Expressiveness of Multi-Neuron Convex Relaxations

2024-10-09 · Yuhao Mao, Yani Zhang, Martin Vechev

To provide robustness guarantees, neural network certification methods heavily rely on convex relaxations. The imprecision of these convex relaxations, however, is a major obstacle: even the most precise single-neuron re…

The Convex Relaxation Barrier, Revisited: Tightened Single-Neuron Relaxations for Neural Network Verification

2020-06-24 · NeurIPS 2020 12 · Christian Tjandraatmadja, Ross Anderson, Joey Huchette, Will Ma 외

We improve the effectiveness of propagation- and linear-optimization-based neural network verification algorithms with a new tightened convex relaxation for ReLU neurons. Unlike previous single-neuron relaxations which f…

The Cost of Relaxation: Evaluating the Error in Convex Neural Network Verification

2026-04-20 · Merkouris Papamichail, Konstantinos Varsos, Giorgos Flouris, João Marques-Silva arxiv

Many neural network (NN) verification systems represent the network's input-output relation as a constraint program. Sound and complete, representations involve integer constraints, for simulating the activations. Recent…

Zonotope Domains for Lagrangian Neural Network Verification

2022-10-14 · Matt Jordan, Jonathan Hayase, Alexandros G. Dimakis, Sewoong Oh

Neural network verification aims to provide provable bounds for the output of a neural network for a given input range. Notable prior works in this domain have either generated bounds using abstract domains, which preser…