paper-with-me

홈 › Papers

Relational representation learning with spike trains

2022-05-18 · Dominik Dold

Relational representation learning has lately received an increase in interest due to its flexibility in modeling a variety of systems like interacting particles, materials and industrial projects for, e.g., the design of spacecraft. A prominent method for dealing with relational data are knowledge graph embedding algorithms, where entities and relations of a knowledge graph are mapped to a low-dimensional vector space while preserving its semantic structure. Recently, a graph embedding method has been proposed that maps graph elements to the temporal domain of spiking neural networks. However, it relies on encoding graph elements through populations of neurons that only spike once. Here, we present a model that allows us to learn spike train-based embeddings of knowledge graphs, requiring only one neuron per graph element by fully utilizing the temporal domain of spike patterns. This coding scheme can be implemented with arbitrary spiking neuron models as long as gradients with respect to spike times can be calculated, which we demonstrate for the integrate-and-fire neuron model. In general, the presented results show how relational knowledge can be integrated into spike-based systems, opening up the possibility of merging event-based computing and relational data to build powerful and energy efficient artificial intelligence applications and reasoning systems.

📄 PDF Abstract BibTeX arXiv:2205.09140

Code (0)

등록된 구현이 없습니다.

Tasks

Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsRepresentation Learning

Similar Papers 제목 키워드 기반

Spiking Neural Network Accelerator Architecture for Differential-Time Representation using Learned Encoding

2025-01-14 · Daniel Windhager, Lothar Ratschbacher, Bernhard A. Moser, Michael Lunglmayr

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs…

Spike Accumulation Forwarding for Effective Training of Spiking Neural Networks

2023-10-04 · Ryuji Saiin, Tomoya Shirakawa, Sota Yoshihara, Yoshihide Sawada 외

In this article, we propose a new paradigm for training spiking neural networks (SNNs), spike accumulation forwarding (SAF). It is known that SNNs are energy-efficient but difficult to train. Consequently, many researche…

Robust online reconstruction of continuous-time signals from a lean spike train ensemble code

2024-08-12 · Anik Chattopadhyay, Arunava Banerjee

Sensory stimuli in animals are encoded into spike trains by neurons, offering advantages such as sparsity, energy efficiency, and high temporal resolution. This paper presents a signal processing framework that determini…

A new class of metrics for spike trains

2012-09-13 · Cătălin V. Rusu, Răzvan V. Florian

The distance between a pair of spike trains, quantifying the differences between them, can be measured using various metrics. Here we introduce a new class of spike train metrics, inspired by the Pompeiu-Hausdorff distan…

On the spike train variability characterized by variance-to-mean power relationship

2015-05-21

We propose a statistical method for modeling the non-Poisson variability of spike trains observed in a wide range of brain regions. Central to our approach is the assumption that the variance and the mean of interspike i…