paper-with-me

Papers

Data-Driven Lipschitz Continuity: A Cost-Effective Approach to Improve Adversarial Robustness

2024-06-28 · Erh-Chung Chen, Pin-Yu Chen, I-Hsin Chung, Che-Rung Lee

The security and robustness of deep neural networks (DNNs) have become increasingly concerning. This paper aims to provide both a theoretical foundation and a practical solution to ensure the reliability of DNNs. We explore the concept of Lipschitz continuity to certify the robustness of DNNs against adversarial attacks, which aim to mislead the network with adding imperceptible perturbations into inputs. We propose a novel algorithm that remaps the input domain into a constrained range, reducing the Lipschitz constant and potentially enhancing robustness. Unlike existing adversarially trained models, where robustness is enhanced by introducing additional examples from other datasets or generative models, our method is almost cost-free as it can be integrated with existing models without requiring re-training. Experimental results demonstrate the generalizability of our method, as it can be combined with various models and achieve enhancements in robustness. Furthermore, our method achieves the best robust accuracy for CIFAR10, CIFAR100, and ImageNet datasets on the RobustBench leaderboard.

📄 PDF Abstract BibTeX arXiv:2406.19622

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Robustness

Similar Papers 제목 키워드 기반

Beyond Lipschitz: Data-Driven Robustness via Discrete Modulus of Continuity

2026-05-27 · Jürgen Dölz, Michael Multerer, Michele Palma arxiv

Robustness of neural networks is commonly quantified via local or global Lipschitz constants. However, Lipschitz continuity can be overly coarse or overly restrictive as global robustness measure, failing to capture nuan…

Lipschitz Continuity of Mahalanobis Distances and Bilinear Forms

2016-04-04 · Valentina Zantedeschi, Rémi Emonet, Marc Sebban

Many theoretical results in the machine learning domain stand only for functions that are Lipschitz continuous. Lipschitz continuity is a strong form of continuity that linearly bounds the variations of a function. In th…

BIG-bench Machine Learning

Lipschitz Continuity Retained Binary Neural Network

2022-07-13 · Yuzhang Shang, Dan Xu, Bin Duan, Ziliang Zong 외

Relying on the premise that the performance of a binary neural network can be largely restored with eliminated quantization error between full-precision weight vectors and their corresponding binary vectors, existing wor…

BinarizationQuantization

Understanding the Effectiveness of Lipschitz-Continuity in Generative Adversarial Nets

2018-07-02 · Zhiming Zhou, Yuxuan Song, Lantao Yu, Hongwei Wang 외

In this paper, we investigate the underlying factor that leads to failure and success in the training of GANs. We study the property of the optimal discriminative function and show that in many GANs, the gradient from th…

valid

Lipschitz Constrained GANs via Boundedness and Continuity

2018-03-16 · Kanglin Liu, Guoping Qiu

One of the challenges in the study of Generative Adversarial Networks (GANs) is the difficulty of its performance control. Lipschitz constraint is essential in guaranteeing training stability for GANs. Although heuristic…