paper-with-me

Papers

Dynamic neural network with memristive CIM and CAM for 2D and 3D vision

2024-07-12 · Yue Zhang, Woyu Zhang, Shaocong Wang, Ning Lin, Yifei Yu, Yangu He, Bo wang, Hao Jiang, Peng Lin, Xiaoxin Xu, Xiaojuan Qi, Zhongrui Wang, Xumeng Zhang, Dashan Shang, Qi Liu, Kwang-Ting Cheng, Ming Liu

The brain is dynamic, associative and efficient. It reconfigures by associating the inputs with past experiences, with fused memory and processing. In contrast, AI models are static, unable to associate inputs with past experiences, and run on digital computers with physically separated memory and processing. We propose a hardware-software co-design, a semantic memory-based dynamic neural network (DNN) using memristor. The network associates incoming data with the past experience stored as semantic vectors. The network and the semantic memory are physically implemented on noise-robust ternary memristor-based Computing-In-Memory (CIM) and Content-Addressable Memory (CAM) circuits, respectively. We validate our co-designs, using a 40nm memristor macro, on ResNet and PointNet++ for classifying images and 3D points from the MNIST and ModelNet datasets, which not only achieves accuracy on par with software but also a 48.1% and 15.9% reduction in computational budget. Moreover, it delivers a 77.6% and 93.3% reduction in energy consumption.

📄 PDF Abstract BibTeX arXiv:2407.08990

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Kaiming Initialization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Gradient-based Neuromorphic Learning on Dynamical RRAM Arrays

2022-06-26 · Peng Zhou, Jason K. Eshraghian, Dong-Uk Choi, Wei D. Lu 외

We present MEMprop, the adoption of gradient-based learning to train fully memristive spiking neural networks (MSNNs). Our approach harnesses intrinsic device dynamics to trigger naturally arising voltage spikes. These s…

Stochastic Deep Learning in Memristive Networks

2017-11-09 · Anakha V Babu, Bipin Rajendran

We study the performance of stochastically trained deep neural networks (DNNs) whose synaptic weights are implemented using emerging memristive devices that exhibit limited dynamic range, resolution, and variability in t…

Deep Learning

A Fully Memristive Spiking Neural Network with Unsupervised Learning

2022-03-02 · Peng Zhou, Dong-Uk Choi, Jason K. Eshraghian, Sung-Mo Kang

We present a fully memristive spiking neural network (MSNN) consisting of physically-realizable memristive neurons and memristive synapses to implement an unsupervised Spiking Time Dependent Plasticity (STDP) learning ru…

Multi-class ClassificationRetrieval

SPICEprop: Backpropagating Errors Through Memristive Spiking Neural Networks

2022-03-02 · Peng Zhou, Jason K. Eshraghian, Dong-Uk Choi, Sung-Mo Kang

We present a fully memristive spiking neural network (MSNN) consisting of novel memristive neurons trained using the backpropagation through time (BPTT) learning rule. Gradient descent is applied directly to the memristi…

Hierarchical Composition of Memristive Networks for Real-Time Computing

2015-04-11 · Jens Bürger, Alireza Goudarzi, Darko Stefanovic, Christof Teuscher

Advances in materials science have led to physical instantiations of self-assembled networks of memristive devices and demonstrations of their computational capability through reservoir computing. Reservoir computing is …