paper-with-me

홈 › Papers

Power and Accuracy of Multi-Layer Perceptrons (MLPs) under Reduced-voltage FPGA BRAMs Operation

2020-05-10 · Behzad Salami, Osman Unsal, Adrian Cristal

In this paper, we exploit the aggressive supply voltage underscaling technique in Block RAMs (BRAMs) of Field Programmable Gate Arrays (FPGAs) to improve the energy efficiency of Multi-Layer Perceptrons (MLPs). Additionally, we evaluate and improve the resilience of this accelerator. Through experiments on several representative FPGA fabrics, we observe that until a minimum safe voltage level, i.e., Vmin the MLP accuracy is not affected. This safe region involves a large voltage guardband. Also, it involves a narrower voltage region where faults start to appear in memories due to the increased circuit delay, but these faults are masked by MLP, and thus, its accuracy is not affected. However, further undervolting causes significant accuracy loss as a result of the fast-increasing high fault rates. Based on the characterization of these undervolting faults, we propose fault mitigation techniques that can effectively improve the resilience behavior of such accelerator. Our evaluation is based on four FPGA platforms. On average, we achieve >90% energy saving with a negligible accuracy loss of up to 0.1%.

📄 PDF Abstract BibTeX arXiv:2005.04737

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A comparative study of back propagation and its alternatives on multilayer perceptrons

2022-05-31 · John Waldo

The de facto algorithm for training the back pass of a feedforward neural network is backpropagation (BP). The use of almost-everywhere differentiable activation functions made it efficient and effective to propagate the…

PAC-Bayesian Generalization Bounds for MultiLayer Perceptrons

2020-06-16 · Xinjie Lan, Xin Guo, Kenneth E. Barner

We study PAC-Bayesian generalization bounds for Multilayer Perceptrons (MLPs) with the cross entropy loss. Above all, we introduce probabilistic explanations for MLPs in two aspects: (i) MLPs formulate a family of Gibbs …

Generalization BoundsVariational Inference

On Graph Neural Networks versus Graph-Augmented MLPs

2020-10-28 · ICLR 2021 1 · Lei Chen, Zhengdao Chen, Joan Bruna

From the perspective of expressive power, this work compares multi-layer Graph Neural Networks (GNNs) with a simplified alternative that we call Graph-Augmented Multi-Layer Perceptrons (GA-MLPs), which first augments nod…

Community DetectionIsomorphism Testing

A preferential interpretation of MultiLayer Perceptrons in a conditional logic with typicality

2023-04-29 · Mario Alviano, Francesco Bartoli, Marco Botta, Roberto Esposito 외

In this paper we investigate the relationships between a multipreferential semantics for defeasible reasoning in knowledge representation and a multilayer neural network model. Weighted knowledge bases for a simple descr…

Universal Equivariant Multilayer Perceptrons

2020-02-07 · ICML 2020 1 · Siamak Ravanbakhsh

Group invariant and equivariant Multilayer Perceptrons (MLP), also known as Equivariant Networks, have achieved remarkable success in learning on a variety of data structures, such as sequences, images, sets, and graphs.…