paper-with-me

홈 › Papers

Towards Verifying the Geometric Robustness of Large-scale Neural Networks

2023-01-29 · Fu Wang, Peipei Xu, Wenjie Ruan, Xiaowei Huang

Deep neural networks (DNNs) are known to be vulnerable to adversarial geometric transformation. This paper aims to verify the robustness of large-scale DNNs against the combination of multiple geometric transformations with a provable guarantee. Given a set of transformations (e.g., rotation, scaling, etc.), we develop GeoRobust, a black-box robustness analyser built upon a novel global optimisation strategy, for locating the worst-case combination of transformations that affect and even alter a network's output. GeoRobust can provide provable guarantees on finding the worst-case combination based on recent advances in Lipschitzian theory. Due to its black-box nature, GeoRobust can be deployed on large-scale DNNs regardless of their architectures, activation functions, and the number of neurons. In practice, GeoRobust can locate the worst-case geometric transformation with high precision for the ResNet50 model on ImageNet in a few seconds on average. We examined 18 ImageNet classifiers, including the ResNet family and vision transformers, and found a positive correlation between the geometric robustness of the networks and the parameter numbers. We also observe that increasing the depth of DNN is more beneficial than increasing its width in terms of improving its geometric robustness. Our tool GeoRobust is available at https://github.com/TrustAI/GeoRobust.

📄 PDF Abstract BibTeX arXiv:2301.12456

Code (1)

trustai/georobust 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Average Pooling 설명 없음
Batch Normalization 설명 없음
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Kaiming Initialization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Similar Papers 제목 키워드 기반

Verifying Robustness of Gradient Boosted Models

2019-06-26 · Gil Einziger, Maayan Goldstein, Yaniv Sa'ar, Itai Segall

Gradient boosted models are a fundamental machine learning technique. Robustness to small perturbations of the input is an important quality measure for machine learning models, but the literature lacks a method to prove…

BIG-bench Machine Learning

Verification of Geometric Robustness of Neural Networks via Piecewise Linear Approximation and Lipschitz Optimisation

2024-08-23 · Ben Batten, Yang Zheng, Alessandro De Palma, Panagiotis Kouvaros 외

We address the problem of verifying neural networks against geometric transformations of the input image, including rotation, scaling, shearing, and translation. The proposed method computes provably sound piecewise line…

Boosting the Robustness Verification of DNN by Identifying the Achilles's Heel

2018-11-17 · Chengdong Feng, Zhenbang Chen, Weijiang Hong, Hengbiao Yu 외

Deep Neural Network (DNN) is a widely used deep learning technique. How to ensure the safety of DNN-based system is a critical problem for the research and application of DNN. Robustness is an important safety property o…

FUSE-Flow: Scalable Real-Time Multi-View Point Cloud Reconstruction Using Confidence

2026-02-01 · Chentian Sun arxiv

Real-time multi-view point cloud reconstruction is a core problem in 3D vision and immersive perception, with wide applications in VR, AR, robotic navigation, digital twins, and computer interaction. Despite advances in …

Point Cloud GenerationPoint Clouds

Knowledge Crosswords: Geometric Knowledge Reasoning with Large Language Models

2023-10-02 · Wenxuan Ding, Shangbin Feng, YuHan Liu, Zhaoxuan Tan 외

We propose Knowledge Crosswords, a geometric knowledge reasoning benchmark consisting of incomplete knowledge networks bounded by structured factual constraints, where LLMs are tasked with inferring the missing facts to …