Real-Time Decoding of an Integrate and Fire Encoder
Neuronal encoding models range from the detailed biophysically-based Hodgkin Huxley model, to the statistical linear time invariant model specifying firing rates in terms of the extrinsic signal. Decoding the former becomes intractable, while the latter does not adequately capture the nonlinearities present in the neuronal encoding system. For use in practical applications, we wish to record the output of neurons, namely spikes, and decode this signal fast in order to drive a machine, for example a prosthetic device. Here, we introduce a causal, real-time decoder of the biophysically-based Integrate and Fire encoding neuron model. We show that the upper bound of the real-time reconstruction error decreases polynomially in time, and that the L2 norm of the error is bounded by a constant that depends on the density of the spikes, as well as the bandwidth and the decay of the input signal. We numerically validate the effect of these parameters on the reconstruction error.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderSimilar Papers 제목 키워드 기반
Obscured Wildfire Flame Detection By Temporal Analysis of Smoke Patterns Captured by Unmanned Aerial Systems
This research paper addresses the challenge of detecting obscured wildfires (when the fire flames are covered by trees, smoke, clouds, and other natural barriers) in real-time using drones equipped only with RGB cameras.…
DecoderSemantic SegmentationSimul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection
As a robust and large-scale multilingual speech recognition model, Whisper has demonstrated impressive results in many low-resource and out-of-distribution scenarios. However, its encoder-decoder structure hinders its ap…
Decoderspeech-recognitionSpeech RecognitionFastLR: Non-Autoregressive Lipreading Model with Integrate-and-Fire
Lipreading is an impressive technique and there has been a definite improvement of accuracy in recent years. However, existing methods for lipreading mainly build on autoregressive (AR) model, which generate target token…
DecoderLanguage ModellingLipreadingA Real-time Fire Segmentation Method Based on A Deep Learning Approach
As a kind of the forest “fault”, fire is highly destructive and difficult to rescue. Fire segmentation is helpful for firefighters to understand the fire scale and formulate a reasonable fire-fighting plan. Therefore, th…
DecoderReal-Time Semantic SegmentationSegmentationWhen Spiking neural networks meet temporal attention image decoding and adaptive spiking neuron
Spiking Neural Networks (SNNs) are capable of encoding and processing temporal information in a biologically plausible way. However, most existing SNN-based methods for image tasks do not fully exploit this feature. More…