paper-with-me

Papers

Resistive Neural Hardware Accelerators

2021-09-08 · Kamilya Smagulova, Mohammed E. Fouda, Fadi Kurdahi, Khaled Salama, Ahmed Eltawil

Deep Neural Networks (DNNs), as a subset of Machine Learning (ML) techniques, entail that real-world data can be learned and that decisions can be made in real-time. However, their wide adoption is hindered by a number of software and hardware limitations. The existing general-purpose hardware platforms used to accelerate DNNs are facing new challenges associated with the growing amount of data and are exponentially increasing the complexity of computations. An emerging non-volatile memory (NVM) devices and processing-in-memory (PIM) paradigm is creating a new hardware architecture generation with increased computing and storage capabilities. In particular, the shift towards ReRAM-based in-memory computing has great potential in the implementation of area and power efficient inference and in training large-scale neural network architectures. These can accelerate the process of the IoT-enabled AI technologies entering our daily life. In this survey, we review the state-of-the-art ReRAM-based DNN many-core accelerators, and their superiority compared to CMOS counterparts was shown. The review covers different aspects of hardware and software realization of DNN accelerators, their present limitations, and future prospectives. In particular, comparison of the accelerators shows the need for the introduction of new performance metrics and benchmarking standards. In addition, the major concerns regarding the efficient design of accelerators include a lack of accuracy in simulation tools for software and hardware co-design.

📄 PDF Abstract BibTeX arXiv:2109.03934

Code (0)

등록된 구현이 없습니다.

Tasks

Benchmarking

Similar Papers 제목 키워드 기반

A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms

2023-06-27 · Cristina Silvano, Daniele Ielmini, Fabrizio Ferrandi, Leandro Fiorin 외

Recent trends in deep learning (DL) have made hardware accelerators essential for various high-performance computing (HPC) applications, including image classification, computer vision, and speech recognition. This surve…

Deep LearningGPUimage-classificationImage Classification+3

Zero-shifting Technique for Deep Neural Network Training on Resistive Cross-point Arrays

2019-07-24 · Hyungjun Kim, Malte Rasch, Tayfun Gokmen, Takashi Ando 외

A resistive memory device-based computing architecture is one of the promising platforms for energy-efficient Deep Neural Network (DNN) training accelerators. The key technical challenge in realizing such accelerators is…

Algorithm for Training Neural Networks on Resistive Device Arrays

2019-09-17 · Tayfun Gokmen, Wilfried Haensch

Hardware architectures composed of resistive cross-point device arrays can provide significant power and speed benefits for deep neural network training workloads using stochastic gradient descent (SGD) and backpropagati…

FARe: Fault-Aware GNN Training on ReRAM-based PIM Accelerators

2024-01-19 · Pratyush Dhingra, Chukwufumnanya Ogbogu, Biresh Kumar Joardar, Janardhan Rao Doppa 외

Resistive random-access memory (ReRAM)-based processing-in-memory (PIM) architecture is an attractive solution for training Graph Neural Networks (GNNs) on edge platforms. However, the immature fabrication process and li…

Neural-PIM: Efficient Processing-In-Memory with Neural Approximation of Peripherals

2022-01-30 · Weidong Cao, Yilong Zhao, Adith Boloor, Yinhe Han 외

Processing-in-memory (PIM) architectures have demonstrated great potential in accelerating numerous deep learning tasks. Particularly, resistive random-access memory (RRAM) devices provide a promising hardware substrate …

Quantization