Deep Neural Network Optimized to Resistive Memory with Nonlinear Current-Voltage Characteristics
Artificial Neural Network computation relies on intensive vector-matrix multiplications. Recently, the emerging nonvolatile memory (NVM) crossbar array showed a feasibility of implementing such operations with high energy efficiency, thus there are many works on efficiently utilizing emerging NVM crossbar array as analog vector-matrix multiplier. However, its nonlinear I-V characteristics restrain critical design parameters, such as the read voltage and weight range, resulting in substantial accuracy loss. In this paper, instead of optimizing hardware parameters to a given neural network, we propose a methodology of reconstructing a neural network itself optimized to resistive memory crossbar arrays. To verify the validity of the proposed method, we simulated various neural network with MNIST and CIFAR-10 dataset using two different specific Resistive Random Access Memory (RRAM) model. Simulation results show that our proposed neural network produces significantly higher inference accuracies than conventional neural network when the synapse devices have nonlinear I-V characteristics.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Voltage Control of the Boost Converter: PI vs. Nonlinear Passivity-based Control
We carry-out a detailed analysis of direct voltage control of a Boost converter feeding a simple resistive load. First, we prove that using a classical PI control to stabilize a desired equilibrium leads to a very compli…
Modelling Resistive and Phase Change Memory with Passive Selector Arrays -- A Matlab Tool
Memristor devices are crucial for developing neuromorphic computers and next-generation memory technologies. In this work, we provide a comprehensive modelling tool for simulating static DC reading operations of memristo…
CPUIMBUE: In-Memory Boolean-to-CUrrent Inference ArchitecturE for Tsetlin Machines
In-memory computing for Machine Learning (ML) applications remedies the von Neumann bottlenecks by organizing computation to exploit parallelism and locality. Non-volatile memory devices such as Resistive RAM (ReRAM) off…
Frequency propagation: Multi-mechanism learning in nonlinear physical networks
We introduce frequency propagation, a learning algorithm for nonlinear physical networks. In a resistive electrical circuit with variable resistors, an activation current is applied at a set of input nodes at one frequen…
Output Voltage Regulation of a Fuel Cell/Boost Converter System: A PI-PBC Approach
In this paper we consider the problem of voltage regulation of a proton exchange membrane fuel cell connected to an uncertain load through a boost converter. We show that, in spite of the inherent nonlinearities in the c…