Collective Robustness Certificates: Exploiting Interdependence in Graph Neural Networks
In tasks like node classification, image segmentation, and named-entity recognition we have a classifier that simultaneously outputs multiple predictions (a vector of labels) based on a single input, i.e. a single graph, image, or document respectively. Existing adversarial robustness certificates consider each prediction independently and are thus overly pessimistic for such tasks. They implicitly assume that an adversary can use different perturbed inputs to attack different predictions, ignoring the fact that we have a single shared input. We propose the first collective robustness certificate which computes the number of predictions that are simultaneously guaranteed to remain stable under perturbation, i.e. cannot be attacked. We focus on Graph Neural Networks and leverage their locality property - perturbations only affect the predictions in a close neighborhood - to fuse multiple single-node certificates into a drastically stronger collective certificate. For example, on the Citeseer dataset our collective certificate for node classification increases the average number of certifiable feature perturbations from $7$ to $351$.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial RobustnessImage Segmentationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Node ClassificationSemantic SegmentationSimilar Papers 제목 키워드 기반
Collective Robustness Certificates
In tasks like node classification, image segmentation, and named-entity recognition we have a classifier that simultaneously outputs multiple predictions (a vector of labels) based on a single input, i.e. a single graph,…
Adversarial RobustnessImage Segmentationnamed-entity-recognitionNamed Entity Recognition+3Collective Certified Robustness against Graph Injection Attacks
We investigate certified robustness for GNNs under graph injection attacks. Existing research only provides sample-wise certificates by verifying each node independently, leading to very limited certifying performance. I…
Exact Certification of (Graph) Neural Networks Against Label Poisoning
Machine learning models are highly vulnerable to label flipping, i.e., the adversarial modification (poisoning) of training labels to compromise performance. Thus, deriving robustness certificates is important to guarant…
Bilevel OptimizationNode ClassificationStructure-Aware Robustness Certificates for Graph Classification
Certifying the robustness of a graph-based machine learning model poses a critical challenge for safety. Current robustness certificates for graph classifiers guarantee output invariance with respect to the total number …
ClassificationGraph ClassificationLocalized Randomized Smoothing for Collective Robustness Certification
Models for image segmentation, node classification and many other tasks map a single input to multiple labels. By perturbing this single shared input (e.g. the image) an adversary can manipulate several predictions (e.g.…
Image SegmentationNode ClassificationSemantic Segmentation