paper-with-me

홈 › Papers

DeepSplit: Scalable Verification of Deep Neural Networks via Operator Splitting

2021-06-16 · Shaoru Chen, Eric Wong, J. Zico Kolter, Mahyar Fazlyab

Analyzing the worst-case performance of deep neural networks against input perturbations amounts to solving a large-scale non-convex optimization problem, for which several past works have proposed convex relaxations as a promising alternative. However, even for reasonably-sized neural networks, these relaxations are not tractable, and so must be replaced by even weaker relaxations in practice. In this work, we propose a novel operator splitting method that can directly solve a convex relaxation of the problem to high accuracy, by splitting it into smaller sub-problems that often have analytical solutions. The method is modular, scales to very large problem instances, and compromises operations that are amenable to fast parallelization with GPU acceleration. We demonstrate our method in bounding the worst-case performance of large convolutional networks in image classification and reinforcement learning settings, and in reachability analysis of neural network dynamical systems.

📄 PDF Abstract BibTeX arXiv:2106.09117

Code (1)

shaoruchen/deepsplit 공식 구현 pytorch

Tasks

GPUimage-classificationImage Classification

Similar Papers 제목 키워드 기반

Variable Metric Splitting Methods for Neuromorphic Circuits Simulation

2025-04-09 · Amir Shahhosseini, Thomas Burger, Rodolphe Sepulchre

This paper proposes a variable metric splitting algorithm to solve the electrical behavior of neuromorphic circuits made of capacitors, memristive elements, and batteries. The gradient property of the memristive elements…

Accurate Reaction-Diffusion Operator Splitting on Tetrahedral Meshes for Parallel Stochastic Molecular Simulations

2015-12-10

Spatial stochastic molecular simulations in biology are limited by the intense computation required to track molecules in space either in a discrete time or discrete space framework, meaning that the serial limit has alr…

An Operator-Theoretic Framework to Simulate Neuromorphic Circuits

2024-04-09 · Amir Shahhosseini, Thomas Chaffey, Rodolphe Sepulchre

Splitting algorithms are well-established in convex optimization and are designed to solve large-scale problems. Using such algorithms to simulate the behavior of nonlinear circuit networks provides scalable methods for …

Connections between Operator-splitting Methods and Deep Neural Networks with Applications in Image Segmentation

2023-07-18 · Hao liu, Xue-Cheng Tai, Raymond Chan

Deep neural network is a powerful tool for many tasks. Understanding why it is so successful and providing a mathematical explanation is an important problem and has been one popular research direction in past years. In …

Image SegmentationSemantic Segmentation

Broadening the Applicability of Conditional Syntax Splitting for Reasoning from Conditional Belief Bases

2026-04-14 · Lars-Phillip Spiegel, Jonas Haldimann, Jesse Heyninck, Gabriele Kern-Isberner 외 arxiv

In nonmonotonic reasoning from conditional belief bases, an inference operator satisfying syntax splitting postulates allows for taking only the relevant parts of a belief base into account, provided that the belief base…