Cortical Processing with Thermodynamic-RAM
AHaH computing forms a theoretical framework from which a biologically-inspired type of computing architecture can be built where, unlike von Neumann systems, memory and processor are physically combined. In this paper we report on an incremental step beyond the theoretical framework of AHaH computing toward the development of a memristor-based physical neural processing unit (NPU), which we call Thermodynamic-RAM (kT-RAM). While the power consumption and speed dominance of such an NPU over von Neumann architectures for machine learning applications is well appreciated, Thermodynamic-RAM offers several advantages over other hardware approaches to adaptation and learning. Benefits include general-purpose use, a simple yet flexible instruction set and easy integration into existing digital platforms. We present a high level design of kT-RAM and a formal definition of its instruction set. We report the completion of a kT-RAM emulator and the successful port of all previous machine learning benchmark applications including unsupervised clustering, supervised and unsupervised classification, complex signal prediction, unsupervised robotic actuation and combinatorial optimization. Lastly, we extend a previous MNIST hand written digits benchmark application, to show that an extra step of reading the synaptic states of AHaH nodes during the train phase (healing) alone results in plasticity that improves the classifier's performance, bumping our best F1 score up to 99.5%.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningClusteringCombinatorial OptimizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Energy Consumption Optimization, Response Time Differences and Indicators in Cortical Working Memory Revealed by Nonequilibrium
The neocortex, a complex system driving multi-region interactions, remains a core puzzle in neuroscience. Despite quantitative insights across brain scales, understanding the mechanisms underlying neural activities is ch…
Stochastic thermodynamic limit on E. coli adaptation by Information geometric approach
Biological systems process information under noisy environment. Sensory adaptation model of E. coli is suitable for investigation because of its simplicity. To understand the adaptation processing quantitatively, stochas…
Preterm neonates distinguish rhythm violation through a hierarchy of cortical processing
Rhythm is a fundamental component of the auditory world, present even during the prenatal life. While there is evidence that some auditory capacities are already present before birth, whether and how the premature neural…
RhythmStance leg and surface stability modulate cortical activity during human single leg stance
Mobile Electroencephalography (EEG) provides insights into cortical contributions to postural control. Although changes in theta (4–8 Hz) and alpha frequency power (8–12 Hz) were shown to reflect attentional and sensorim…
EEGElectroencephalogram (EEG)Cortical Surface Parcellation using Spherical Convolutional Neural Networks
We present cortical surface parcellation using spherical deep convolutional neural networks. Traditional multi-atlas cortical surface parcellation requires inter-subject surface registration using geometric features with…
MORPH