paper-with-me

홈 › Papers

Spiking GATs: Learning Graph Attentions via Spiking Neural Network

2022-09-05 · Beibei Wang, Bo Jiang

Graph Attention Networks (GATs) have been intensively studied and widely used in graph data learning tasks. Existing GATs generally adopt the self-attention mechanism to conduct graph edge attention learning, requiring expensive computation. It is known that Spiking Neural Networks (SNNs) can perform inexpensive computation by transmitting the input signal data into discrete spike trains and can also return sparse outputs. Inspired by the merits of SNNs, in this work, we propose a novel Graph Spiking Attention Network (GSAT) for graph data representation and learning. In contrast to self-attention mechanism in existing GATs, the proposed GSAT adopts a SNN module architecture which is obvious energy-efficient. Moreover, GSAT can return sparse attention coefficients in natural and thus can perform feature aggregation on the selective neighbors which makes GSAT perform robustly w.r.t graph edge noises. Experimental results on several datasets demonstrate the effectiveness, energy efficiency and robustness of the proposed GSAT model.

📄 PDF Abstract BibTeX arXiv:2209.13539

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Attention

Similar Papers 제목 키워드 기반

Improving vision-language alignment with graph spiking hybrid Networks

2025-01-31 · Siyu Zhang, Heming Zheng, Yiming Wu, Yeming Chen

To bridge the semantic gap between vision and language (VL), it is necessary to develop a good alignment strategy, which includes handling semantic diversity, abstract representation of visual information, and generaliza…

Contrastive LearningDiversityGraph AttentionPanoptic Segmentation

DISTA: Denoising Spiking Transformer with intrinsic plasticity and spatiotemporal attention

2023-11-15 · Boxun Xu, Hejia Geng, Yuxuan Yin, Peng Li

Among the array of neural network architectures, the Vision Transformer (ViT) stands out as a prominent choice, acclaimed for its exceptional expressiveness and consistent high performance in various vision applications.…

Denoising

Sparse Graph Attention Networks

2019-12-02 · Yang Ye, Shihao Ji

Graph Neural Networks (GNNs) have proved to be an effective representation learning framework for graph-structured data, and have achieved state-of-the-art performance on many practical predictive tasks, such as node cla…

ClassificationGeneral ClassificationGraph AttentionGraph Classification+4

Neuro-symbolic computing with spiking neural networks

2022-08-04 · Dominik Dold, Josep Soler Garrido, Victor Caceres Chian, Marcel Hildebrandt 외

Knowledge graphs are an expressive and widely used data structure due to their ability to integrate data from different domains in a sensible and machine-readable way. Thus, they can be used to model a variety of systems…

Graph EmbeddingGraph Neural NetworkKnowledge GraphsOpen-Ended Question Answering

When Prompting Meets Spiking: Graph Sparse Prompting via Spiking Graph Prompt Learning

2026-01-06 · Bo Jiang, Weijun Zhao, Beibei Wang, Jin Tang arxiv

Graph Prompt Feature (GPF) learning has been widely used in adapting pre-trained GNN model on the downstream task. GPFs first introduce some prompt atoms and then learns the optimal prompt vector for each graph node usin…

Representation Learning