Online training for high-performance analogue readout layers in photonic reservoir computers
Introduction. Reservoir Computing is a bio-inspired computing paradigm for processing time-dependent signals. The performance of its hardware implementation is comparable to state-of-the-art digital algorithms on a series of benchmark tasks. The major bottleneck of these implementation is the readout layer, based on slow offline post-processing. Few analogue solutions have been proposed, but all suffered from notice able decrease in performance due to added complexity of the setup. Methods. Here we propose the use of online training to solve these issues. We study the applicability of this method using numerical simulations of an experimentally feasible reservoir computer with an analogue readout layer. We also consider a nonlinear output layer, which would be very difficult to train with traditional methods. Results. We show numerically that online learning allows to circumvent the added complexity of the analogue layer and obtain the same level of performance as with a digital layer. Conclusion. This work paves the way to high-performance fully-analogue reservoir computers through the use of online training of the output layers.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Fully analogue in-memory neural computing via quantum tunneling effect
Fully analogue neural computation requires hardware that can implement both linear and nonlinear transformations without digital assistance. While analogue in-memory computing efficiently realizes matrix-vector multiplic…
Boolean learning under noise-perturbations in hardware neural networks
A high efficiency hardware integration of neural networks benefits from realizing nonlinearity, network connectivity and learning fully in a physical substrate. Multiple systems have recently implemented some or all of t…
Fourier Neural Operators with Least-Squares Readout Refit for Learning Random Obstacle-to-Solution Maps
We study operator learning for random obstacle-to-solution maps arising from elliptic variational inequalities with finite-band self-affine random obstacle fields. Instead of introducing an explicit truncated stochastic …
Random pattern and frequency generation using a photonic reservoir computer with output feedback
Reservoir computing is a bio-inspired computing paradigm for processing time dependent signals. The performance of its analogue implementations matches other digital algorithms on a series of benchmark tasks. Their poten…
Time SeriesTime Series AnalysisTime Series GenerationOnline Training of an Opto-Electronic Reservoir Computer Applied to Real-Time Channel Equalisation
Reservoir Computing is a bio-inspired computing paradigm for processing time dependent signals. The performance of its analogue implementation are comparable to other state of the art algorithms for tasks such as speech …
speech-recognitionSpeech RecognitionTime SeriesTime Series Analysis+1