Spiking GATs: Learning Graph Attentions via Spiking Neural Network
Graph Attention Networks (GATs) have been intensively studied and widely used in graph data learning tasks. Existing GATs generally adopt the self-attention mechanism to conduct graph edge attention learning, requiring expensive computation. It is known that Spiking Neural Networks (SNNs) can perform inexpensive computation by transmitting the input signal data into discrete spike trains and can also return sparse outputs. Inspired by the merits of SNNs, in this work, we propose a novel Graph Spiking Attention Network (GSAT) for graph data representation and learning. In contrast to self-attention mechanism in existing GATs, the proposed GSAT adopts a SNN module architecture which is obvious energy-efficient. Moreover, GSAT can return sparse attention coefficients in natural and thus can perform feature aggregation on the selective neighbors which makes GSAT perform robustly w.r.t graph edge noises. Experimental results on several datasets demonstrate the effectiveness, energy efficiency and robustness of the proposed GSAT model.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph AttentionSimilar Papers 제목 키워드 기반
Improving vision-language alignment with graph spiking hybrid Networks
To bridge the semantic gap between vision and language (VL), it is necessary to develop a good alignment strategy, which includes handling semantic diversity, abstract representation of visual information, and generaliza…
Contrastive LearningDiversityGraph AttentionPanoptic SegmentationDISTA: Denoising Spiking Transformer with intrinsic plasticity and spatiotemporal attention
Among the array of neural network architectures, the Vision Transformer (ViT) stands out as a prominent choice, acclaimed for its exceptional expressiveness and consistent high performance in various vision applications.…
DenoisingSparse Graph Attention Networks
Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node cla…
ClassificationGeneral ClassificationGraph AttentionGraph Classification+4Neuro-symbolic computing with spiking neural networks
Knowledge graphs are an expressive and widely used data structure due to their ability to integrate data from different domains in a sensible and machine-readable way. Thus, they can be used to model a variety of systems…
Graph EmbeddingGraph Neural NetworkKnowledge GraphsOpen-Ended Question AnsweringWhen Prompting Meets Spiking: Graph Sparse Prompting via Spiking Graph Prompt Learning
Graph Prompt Feature (GPF) learning has been widely used in adapting pre-trained GNN model on the downstream task. GPFs first introduce some prompt atoms and then learns the optimal prompt vector for each graph node usin…
Representation Learning