SpikE: spike-based embeddings for multi-relational graph data
Despite the recent success of reconciling spike-based coding with the error backpropagation algorithm, spiking neural networks are still mostly applied to tasks stemming from sensory processing, operating on traditional data structures like visual or auditory data. A rich data representation that finds wide application in industry and research is the so-called knowledge graph - a graph-based structure where entities are depicted as nodes and relations between them as edges. Complex systems like molecules, social networks and industrial factory systems can be described using the common language of knowledge graphs, allowing the usage of graph embedding algorithms to make context-aware predictions in these information-packed environments. We propose a spike-based algorithm where nodes in a graph are represented by single spike times of neuron populations and relations as spike time differences between populations. Learning such spike-based embeddings only requires knowledge about spike times and spike time differences, compatible with recently proposed frameworks for training spiking neural networks. The presented model is easily mapped to current neuromorphic hardware systems and thereby moves inference on knowledge graphs into a domain where these architectures thrive, unlocking a promising industrial application area for this technology.
Code (1)
Tasks
Graph EmbeddingKnowledge GraphsSimilar Papers 제목 키워드 기반
Relational representation learning with spike trains
Relational representation learning has lately received an increase in interest due to its flexibility in modeling a variety of systems like interacting particles, materials and industrial projects for, e.g., the design o…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsRepresentation LearningVL2Spike: Spike-driven Distillation from VLMs for Low-Power Visual Perception in Embodied AI
Spiking neural networks (SNNs) are brain-inspired, event-driven models that compute with sparse spikes, which enables highly efficient visual perception in resource-constrained embodied AI models. The emergence of Spikin…
Visual Place RecognitionKnowledge DistillationTime CNN and Graph Convolution Network for Epileptic Spike Detection in MEG Data
Magnetoencephalography (MEG) recordings of patients with epilepsy exhibit spikes, a typical biomarker of the pathology. Detecting those spikes allows accurate localization of brain regions triggering seizures. Spike dete…
Scaling Up Dynamic Graph Representation Learning via Spiking Neural Networks
Recent years have seen a surge in research on dynamic graph representation learning, which aims to model temporal graphs that are dynamic and evolving constantly over time. However, current work typically models graph dy…
Graph Representation LearningNode ClassificationRepresentation LearningWord2Spike: Poisson Rate Coding for Associative Memories and Neuromorphic Algorithms
Spiking neural networks offer a promising path toward energy-efficient, brain-like associative memory. This paper introduces Word2Spike, a novel rate coding mechanism that combines continuous word embeddings and neuromor…
Semantic Similarity