paper-with-me

Papers

Graph Robustness Benchmark: Benchmarking the Adversarial Robustness of Graph Machine Learning

2021-11-08 · Qinkai Zheng, Xu Zou, Yuxiao Dong, Yukuo Cen, Da Yin, Jiarong Xu, Yang Yang, Jie Tang

Adversarial attacks on graphs have posed a major threat to the robustness of graph machine learning (GML) models. Naturally, there is an ever-escalating arms race between attackers and defenders. However, the strategies behind both sides are often not fairly compared under the same and realistic conditions. To bridge this gap, we present the Graph Robustness Benchmark (GRB) with the goal of providing a scalable, unified, modular, and reproducible evaluation for the adversarial robustness of GML models. GRB standardizes the process of attacks and defenses by 1) developing scalable and diverse datasets, 2) modularizing the attack and defense implementations, and 3) unifying the evaluation protocol in refined scenarios. By leveraging the GRB pipeline, the end-users can focus on the development of robust GML models with automated data processing and experimental evaluations. To support open and reproducible research on graph adversarial learning, GRB also hosts public leaderboards across different scenarios. As a starting point, we conduct extensive experiments to benchmark baseline techniques. GRB is open-source and welcomes contributions from the community. Datasets, codes, leaderboards are available at https://cogdl.ai/grb/home.

📄 PDF Abstract BibTeX arXiv:2111.04314

Code (1)

thudm/grb 공식 구현 pytorch

Tasks

Adversarial RobustnessBenchmarkingBIG-bench Machine Learning

Similar Papers 제목 키워드 기반

RL-Based Method for Benchmarking the Adversarial Resilience and Robustness of Deep Reinforcement Learning Policies

2019-06-03 · Vahid Behzadan, William Hsu

This paper investigates the resilience and robustness of Deep Reinforcement Learning (DRL) policies to adversarial perturbations in the state space. We first present an approach for the disentanglement of vulnerabilities…

BenchmarkingDeep Reinforcement LearningDisentanglementreinforcement-learning+4

A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinking

2023-02-28 · Chang Liu, Yinpeng Dong, Wenzhao Xiang, Xiao Yang 외

The robustness of deep neural networks is usually lacking under adversarial examples, common corruptions, and distribution shifts, which becomes an important research problem in the development of deep learning. Although…

Adversarial RobustnessBenchmarkingimage-classificationImage Classification+1

RobustART: Benchmarking Robustness on Architecture Design and Training Techniques

2021-09-11 · Shiyu Tang, Ruihao Gong, Yan Wang, Aishan Liu 외

Deep neural networks (DNNs) are vulnerable to adversarial noises, which motivates the benchmark of model robustness. Existing benchmarks mainly focus on evaluating defenses, but there are no comprehensive studies of how …

Adversarial RobustnessBenchmarkingData AugmentationNeural Architecture Search

VISAT: Benchmarking Adversarial and Distribution Shift Robustness in Traffic Sign Recognition with Visual Attributes

2025-10-29 · Simon Yu, Peilin Yu, Hongbo Zheng, Huajie Shao 외 arxiv

We present VISAT, a novel open dataset and benchmarking suite for evaluating model robustness in the task of traffic sign recognition with the presence of visual attributes. Built upon the Mapillary Traffic Sign Dataset …

Traffic Sign RecognitionMulti-Task LearningAdversarial AttackAutonomous Driving

Benchmarking the Spatial Robustness of DNNs via Natural and Adversarial Localized Corruptions

2025-04-02 · Giulia Marchiori Pietrosanti, Giulio Rossolini, Alessandro Biondi, Giorgio Buttazzo

The robustness of DNNs is a crucial factor in safety-critical applications, particularly in complex and dynamic environments where localized corruptions can arise. While previous studies have evaluated the robustness of …

BenchmarkingSegmentationSemantic Segmentation