paper-with-me

Papers

Analyzing Deep Neural Networks with Symbolic Propagation: Towards Higher Precision and Faster Verification

2019-02-26 · Jianlin Li, Pengfei Yang, Jiangchao Liu, Liqian Chen, Xiaowei Huang, Lijun Zhang

Deep neural networks (DNNs) have been shown lack of robustness for the vulnerability of their classification to small perturbations on the inputs. This has led to safety concerns of applying DNNs to safety-critical domains. Several verification approaches have been developed to automatically prove or disprove safety properties of DNNs. However, these approaches suffer from either the scalability problem, i.e., only small DNNs can be handled, or the precision problem, i.e., the obtained bounds are loose. This paper improves on a recent proposal of analyzing DNNs through the classic abstract interpretation technique, by a novel symbolic propagation technique. More specifically, the values of neurons are represented symbolically and propagated forwardly from the input layer to the output layer, on top of abstract domains. We show that our approach can achieve significantly higher precision and thus can prove more properties than using only abstract domains. Moreover, we show that the bounds derived from our approach on the hidden neurons, when applied to a state-of-the-art SMT based verification tool, can improve its performance. We implement our approach into a software tool and validate it over a few DNNs trained on benchmark datasets such as MNIST, etc.

📄 PDF Abstract BibTeX arXiv:1902.09866

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Parsing the Language of Expression: Enhancing Symbolic Regression with Domain-Aware Symbolic Priors

2025-03-12 · Sikai Huang, Yixin Berry Wen, Tara Adusumilli, Kusum Choudhary 외

Symbolic regression is essential for deriving interpretable expressions that elucidate complex phenomena by exposing the underlying mathematical and physical relationships in data. In this paper, we present an advanced s…

regressionSymbolic Regression

Low-Precision Mixed-Computation Models for Inference on Edge

2023-12-03 · Seyedarmin Azizi, Mahdi Nazemi, Mehdi Kamal, Massoud Pedram

This paper presents a mixed-computation neural network processing approach for edge applications that incorporates low-precision (low-width) Posit and low-precision fixed point (FixP) number systems. This mixed-computati…

Quantization

Equivariant Neural Belief Propagation

2026-06-04 · Zehua Cheng, Wei Dai, Jiahao Sun arxiv

Probabilistic inference over spatially embedded variables requires beliefs that respect $SE(3)$ symmetry, yet existing equivariant networks produce only scalars and vectors -- not the rank-2 precision tensors needed for …

Dolphin: A Programmable Framework for Scalable Neurosymbolic Learning

2024-10-04 · Aaditya Naik, Jason Liu, Claire Wang, Saikat Dutta 외

Neurosymbolic learning enables the integration of symbolic reasoning with deep learning but faces significant challenges in scaling to complex symbolic programs, large datasets, or both. We introduce Dolphin, a framework…

CPUDeep LearningGPU

SymForce: Symbolic Computation and Code Generation for Robotics

2022-04-17 · Hayk Martiros, Aaron Miller, Nathan Bucki, Bradley Solliday 외

We present SymForce, a library for fast symbolic computation, code generation, and nonlinear optimization for robotics applications like computer vision, motion planning, and controls. SymForce combines the development s…

Code GenerationMathMotion Planning