Stochastic Interpretation of Quasi-periodic Event-based Systems
Many networks used in machine learning and as models of biological neural networks make use of stochastic neurons or neuron-like units. We show that stochastic artificial neurons can be realized on silicon chips by exploiting the quasi-periodic behavior of mismatched analog oscillators to approximate the neuron's stochastic activation function. We represent neurons by finite state machines (FSMs) that communicate using digital events and whose transitions are event-triggered. The event generation times of each neuron are controlled by an analog oscillator internal to that neuron/FSM and the frequencies of the oscillators in different FSMs are incommensurable. We show that within this quasi-periodic system, the transition graph of a FSM can be interpreted as the transition graph of a Markov chain and we show that by using different FSMs, we can obtain approximations of different stochastic activation functions. We investigate the quality of the stochastic interpretation of such a deterministic system and we use the system to realize and sample from a restricted Boltzmann machine. We implemented the quasi-periodic event-based system on a custom silicon chip and we show that the chip behavior can be used to closely approximate a stochastic sampling task.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Quasiperiodic Disturbance Observer for Wideband Harmonic Suppression
Periodic disturbances composed of harmonics typically occur during periodic operations, impairing performance of mechanical and electrical systems. To improve the performance, control of periodic-disturbance suppression …
Separation and Estimation of Periodic/Aperiodic State
Periodicity and aperiodicity can exist in a state simultaneously and typically become quasi-periodicity and quasi-aperiodicity in a dynamically changing state. The quasi-periodic and quasi-aperiodic states existing in th…
Large Language Models as Quasi-crystals: Coherence Without Repetition in Generative Text
This essay proposes an interpretive analogy between large language models (LLMs) and quasicrystals, systems that exhibit global coherence without periodic repetition, generated through local constraints. While LLMs are t…
PhilosophyA Data Driven Method for Computing Quasipotentials
The quasipotential is a natural generalization of the concept of energy functions to non-equilibrium systems. In the analysis of rare events in stochastic dynamics, it plays a central role in characterizing the statistic…
Abstracting the Sampling Behaviour of Stochastic Linear Periodic Event-Triggered Control Systems
Recently, there have been efforts towards understanding the sampling behaviour of event-triggered control (ETC), for obtaining metrics on its sampling performance and predicting its sampling patterns. Finite-state abstra…