paper-with-me

Papers

Hierarchical Randomized Smoothing

2023-10-24 · NeurIPS 2023 11 · Yan Scholten, Jan Schuchardt, Aleksandar Bojchevski, Stephan Günnemann

Real-world data is complex and often consists of objects that can be decomposed into multiple entities (e.g. images into pixels, graphs into interconnected nodes). Randomized smoothing is a powerful framework for making models provably robust against small changes to their inputs - by guaranteeing robustness of the majority vote when randomly adding noise before classification. Yet, certifying robustness on such complex data via randomized smoothing is challenging when adversaries do not arbitrarily perturb entire objects (e.g. images) but only a subset of their entities (e.g. pixels). As a solution, we introduce hierarchical randomized smoothing: We partially smooth objects by adding random noise only on a randomly selected subset of their entities. By adding noise in a more targeted manner than existing methods we obtain stronger robustness guarantees while maintaining high accuracy. We initialize hierarchical smoothing using different noising distributions, yielding novel robustness certificates for discrete and continuous domains. We experimentally demonstrate the importance of hierarchical smoothing in image and node classification, where it yields superior robustness-accuracy trade-offs. Overall, hierarchical smoothing is an important contribution towards models that are both - certifiably robust to perturbations and accurate.

📄 PDF Abstract BibTeX arXiv:2310.16221

Code (0)

등록된 구현이 없습니다.

Tasks

Node Classification

Methods 이 논문이 사용한 방법론

Randomized Smoothing 설명 없음

Similar Papers 제목 키워드 기반

Sound Randomized Smoothing in Floating-Point Arithmetics

2022-07-14 · Václav Voráček, Matthias Hein

Randomized smoothing is sound when using infinite precision. However, we show that randomized smoothing is no longer sound for limited floating-point precision. We present a simple example where randomized smoothing cert…

image-classificationImage Classification

Randomized Smoothing of All Shapes and Sizes

2020-02-19 · ICML 2020 1 · Greg Yang, Tony Duan, J. Edward Hu, Hadi Salman 외

Randomized smoothing is the current state-of-the-art defense with provable robustness against $\ell_2$ adversarial attacks. Many works have devised new randomized smoothing schemes for other metrics, such as $\ell_1$ or …

All

Efficient randomized smoothing by denoising with learned score function

2021-01-01 · Kyungmin Lee, Seyoon Oh

The randomized smoothing with various noise distributions is a promising approach to protect classifiers from $\ell_p$ adversarial attacks. However, it requires an ensemble of classifiers trained with different noise typ…

DenoisingImage Denoising

Certified Adversarial Robustness via Anisotropic Randomized Smoothing

2022-07-12 · Hanbin Hong, Yuan Hong

Randomized smoothing has achieved great success for certified robustness against adversarial perturbations. Given any arbitrary classifier, randomized smoothing can guarantee the classifier's prediction over the perturbe…

Adversarial RobustnessAll

On Certifying Robustness against Backdoor Attacks via Randomized Smoothing

2020-02-26 · Binghui Wang, Xiaoyu Cao, Jinyuan Jia, Neil Zhenqiang Gong

Backdoor attack is a severe security threat to deep neural networks (DNNs). We envision that, like adversarial examples, there will be a cat-and-mouse game for backdoor attacks, i.e., new empirical defenses are developed…

Backdoor Attack