paper-with-me

홈 › Papers

Ralts: Robust Aggregation for Enhancing Graph Neural Network Resilience on Bit-flip Errors

2025-07-24 · Wencheng Zou, Nan Wu arxiv

Graph neural networks (GNNs) have been widely applied in safety-critical applications, such as financial and medical networks, in which compromised predictions may cause catastrophic consequences. While existing research on GNN robustness has primarily focused on software-level threats, hardware-induced faults and errors remain largely underexplored. As hardware systems progress toward advanced technology nodes to meet high-performance and energy efficiency demands, they become increasingly susceptible to transient faults, which can cause bit flips and silent data corruption, a prominent issue observed by major technology companies (e.g., Meta and Google). In response, we first present a comprehensive analysis of GNN robustness against bit-flip errors, aiming to reveal system-level optimization opportunities for future reliable and efficient GNN systems. Second, we propose Ralts, a generalizable and lightweight solution to bolster GNN resilience to bit-flip errors. Specifically, Ralts exploits various graph similarity metrics to filter out outliers and recover compromised graph topology, and incorporates these protective techniques directly into aggregation functions to support any message-passing GNNs. Evaluation results demonstrate that Ralts effectively enhances GNN robustness across a range of GNN models, graph datasets, error patterns, and both dense and sparse architectures. On average, under a BER of $3\times10^{-5}$, these robust aggregation functions improve prediction accuracy by at least 20\% when errors present in model weights or node embeddings, and by at least 10\% when errors occur in adjacency matrices. Ralts is also optimized to deliver execution efficiency comparable to built-in aggregation functions in PyTorch Geometric.

📄 PDF Abstract BibTeX arXiv:2507.18804

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural NetworkGraph Similarity

Similar Papers 제목 키워드 기반

Spectral Thompson sampling

2026-04-15 · Tomas Kocak, Michal Valko, Remi Munos, Shipra Agrawal arxiv

Thompson Sampling (TS) has attracted a lot of interest due to its good empirical performance, in particular in the computational advertising. Though successful, the tools for its performance analysis appeared only recent…

Attacking Graph Neural Networks with Bit Flips: Weisfeiler and Lehman Go Indifferent

2023-11-02 · Lorenz Kummer, Samir Moustafa, Nils N. Kriege, Wilfried N. Gansterer

Prior attacks on graph neural networks have mostly focused on graph poisoning and evasion, neglecting the network's weights and biases. Traditional weight-based fault injection attacks, such as bit flip attacks used for …

Graph Neural NetworkGraph Property PredictionProperty Prediction

Hessian-aware Training for Enhancing DNNs Resilience to Parameter Corruptions

2025-04-02 · Tahmid Hasan Prato, Seijoon Kim, Lizhong Chen, Sanghyun Hong

Deep neural networks are not resilient to parameter corruptions: even a single-bitwise error in their parameters in memory can cause an accuracy drop of over 10%, and in the worst cases, up to 99%. This susceptibility po…

Dynamic Meta-Layer Aggregation for Byzantine-Robust Federated Learning

2026-03-17 · Reek Das, Biplab Kanti Sen arxiv

Federated Learning (FL) is increasingly applied in sectors like healthcare, finance, and IoT, enabling collaborative model training while safeguarding user privacy. However, FL systems are susceptible to Byzantine advers…

Computational EfficiencyFederated Learning

Byzantine-Resilient Federated Learning via Distributed Optimization

2025-03-13 · Yufei Xia, Wenrui Yu, Qiongxiu Li

Byzantine attacks present a critical challenge to Federated Learning (FL), where malicious participants can disrupt the training process, degrade model accuracy, and compromise system reliability. Traditional FL framewor…

Distributed OptimizationFederated Learning