paper-with-me

Papers

Efficient Reprogramming of Memristive Crossbars for DNNs: Weight Sorting and Bit Stucking

2024-10-29 · Matheus Farias, H. T. Kung

We introduce a novel approach to reduce the number of times required for reprogramming memristors on bit-sliced compute-in-memory crossbars for deep neural networks (DNNs). Our idea addresses the limited non-volatile memory endurance, which restrict the number of times they can be reprogrammed. To reduce reprogramming demands, we employ two techniques: (1) we organize weights into sorted sections to schedule reprogramming of similar crossbars, maximizing memristor state reuse, and (2) we reprogram only a fraction of randomly selected memristors in low-order columns, leveraging their bit-level distribution and recognizing their relatively small impact on model accuracy. We evaluate our approach for state-of-the-art models on the ImageNet-1K dataset. We demonstrate a substantial reduction in crossbar reprogramming by 3.7x for ResNet-50 and 21x for ViT-Base, while maintaining model accuracy within a 1% margin.

📄 PDF Abstract BibTeX arXiv:2410.21730

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

BasisN: Reprogramming-Free RRAM-Based In-Memory-Computing by Basis Combination for Deep Neural Networks

2024-07-04 · Amro Eldebiky, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo 외

Deep neural networks (DNNs) have made breakthroughs in various fields including image recognition and language processing. DNNs execute hundreds of millions of multiply-and-accumulate (MAC) operations. To efficiently acc…

Rethinking Non-idealities in Memristive Crossbars for Adversarial Robustness in Neural Networks

2020-08-25 · Abhiroop Bhattacharjee, Priyadarshini Panda

Deep Neural Networks (DNNs) have been shown to be prone to adversarial attacks. Memristive crossbars, being able to perform Matrix-Vector-Multiplications (MVMs) efficiently, are used to realize DNNs on hardware. However,…

Adversarial Robustness

Examining the Robustness of Spiking Neural Networks on Non-ideal Memristive Crossbars

2022-06-20 · Abhiroop Bhattacharjee, Youngeun Kim, Abhishek Moitra, Priyadarshini Panda

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) owing to their asynchronous, sparse, and binary information processing. To improve the energy-efficie…

XploreNAS: Explore Adversarially Robust & Hardware-efficient Neural Architectures for Non-ideal Xbars

2023-02-15 · Abhiroop Bhattacharjee, Abhishek Moitra, Priyadarshini Panda

Compute In-Memory platforms such as memristive crossbars are gaining focus as they facilitate acceleration of Deep Neural Networks (DNNs) with high area and compute-efficiencies. However, the intrinsic non-idealities ass…

Adversarial RobustnessNeural Architecture Search

Current-mode Memristor Crossbars for Neuromemristive Systems

2017-07-17 · Cory Merkel

Motivated by advantages of current-mode design, this brief contribution explores the implementation of weight matrices in neuromemristive systems via current-mode memristor crossbar circuits. After deriving theoretical r…