Exploiting Oxide Based Resistive RAM Variability for Bayesian Neural Network Hardware Design
Uncertainty plays a key role in real-time machine learning. As a significant shift from standard deep networks, which does not consider any uncertainty formulation during its training or inference, Bayesian deep networks are being currently investigated where the network is envisaged as an ensemble of plausible models learnt by the Bayes' formulation in response to uncertainties in sensory data. Bayesian deep networks consider each synaptic weight as a sample drawn from a probability distribution with learnt mean and variance. This paper elaborates on a hardware design that exploits cycle-to-cycle variability of oxide based Resistive Random Access Memories (RRAMs) as a means to realize such a probabilistic sampling function, instead of viewing it as a disadvantage.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
The Combination of Metal Oxides as Oxide Layers for RRAM and Artificial Intelligence
Resistive random-access memory (RRAM) is a promising candidate for next-generation memory devices due to its high speed, low power consumption, and excellent scalability. Metal oxides are commonly used as the oxide layer…
Dielectric ConstantModel of the Weak Reset Process in HfOx Resistive Memory for Deep Learning Frameworks
The implementation of current deep learning training algorithms is power-hungry, owing to data transfer between memory and logic units. Oxide-based RRAMs are outstanding candidates to implement in-memory computing, which…
Deep LearningHandwritten Digit RecognitionIn-Memory Resistive RAM Implementation of Binarized Neural Networks for Medical Applications
The advent of deep learning has considerably accelerated machine learning development. The deployment of deep neural networks at the edge is however limited by their high memory and energy consumption requirements. With …
BIG-bench Machine LearningToward A Formalized Approach for Spike Sorting Algorithms and Hardware Evaluation
Spike sorting algorithms are used to separate extracellular recordings of neuronal populations into single-unit spike activities. The development of customized hardware implementing spike sorting algorithms is burgeoning…
Spike SortingNeuSpin: Design of a Reliable Edge Neuromorphic System Based on Spintronics for Green AI
Internet of Things (IoT) and smart wearable devices for personalized healthcare will require storing and computing ever-increasing amounts of data. The key requirements for these devices are ultra-low-power, high-process…