paper-with-me

홈 › Papers

Hierarchical End-to-End Taylor Bounds for Complete Neural Network Verification

2026-05-11 · Taha Entesari, Mahyar Fazlyab arxiv

Reachability analysis of neural networks, which seeks to compute or bound the set of outputs attainable over a given input domain, is central to certifying safety and robustness in learning-enabled physical systems. Since exact reachable set computation is generally intractable, existing methods typically rely on tractable overapproximations. Examining the state of the art for smooth, twice-differentiable networks, we observe that existing approaches exploit at most second-order information and do not systematically leverage higher-order information. In this work, we introduce \textsc{HiTaB}, a novel verification framework that exploits second-order smoothness through both the Hessian, $\nabla^2 f$, and its Lipschitz constant, $L_{\nabla^2 f}$. We further develop a unified hierarchy of zeroth-, first-, and second-order bounds, together with precise conditions under which higher-order approximations yield provable improvements. Our main technical contribution is a compositional procedure for efficiently bounding $L_{\nabla^2 f}$ in deep neural networks via layerwise propagation of curvature bounds. We extend the framework to both $\ell_2$- and $\ell_\infty$-constrained input sets and show how it can be integrated into branch-and-bound verification pipelines. To our knowledge, this is the first practical reachability analysis framework for smooth neural networks that systematically exploits Lipschitz continuity of curvature, leading to tighter and more informative safety certificates.

📄 PDF Abstract BibTeX arXiv:2605.10621

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Robustness Verification

2021-03-11 · NeurIPS 2021 12 · Shiqi Wang, huan zhang, Kaidi Xu, Xue Lin 외

Bound propagation based incomplete neural network verifiers such as CROWN are very efficient and can significantly accelerate branch-and-bound (BaB) based complete verification of neural networks. However, bound propagat…

Adversarial Attack

Automatically Bounding the Taylor Remainder Series: Tighter Bounds and New Applications

2022-12-22 · Matthew Streeter, Joshua V. Dillon

We present a new algorithm for automatically bounding the Taylor remainder series. In the special case of a scalar function $f: \mathbb{R} \to \mathbb{R}$, our algorithm takes as input a reference point $x_0$, trust regi…

global-optimizationNumerical Integration

A New Approach to Drifting Games, Based on Asymptotically Optimal Potentials

2022-07-23 · Zhilei Wang, Robert V. Kohn

We develop a new approach to drifting games, a class of two-person games with many applications to boosting and online learning settings. Our approach involves (a) guessing an asymptotically optimal potential by solving …

Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Neural Network Robustness Verification

2021-06-18 · NeurIPS 2021 12 · Shiqi Wang, huan zhang, Kaidi Xu, Xue Lin 외

We develop $\beta$-CROWN, a new bound propagation based method that can fully encode neuron split constraints in branch-and-bound (BaB) based complete verification via optimizable parameters $\beta$. When jointly optimiz…

Sound and Complete Verification of Polynomial Networks

2022-09-15 · Elias Abad Rocamora, Mehmet Fatih Sahin, Fanghui Liu, Grigorios G Chrysos 외

Polynomial Networks (PNs) have demonstrated promising performance on face and image recognition recently. However, robustness of PNs is unclear and thus obtaining certificates becomes imperative for enabling their adopti…