paper-with-me

홈 › Papers

A Constant-Time Implementation Methodology for Activation Functions on Microcontrollers

2026-05-21 · Andrii Tyvodar, Andreas Rechberger, Dirmanto Jap, Shivam Bhasin, Bernhard Jungk, Jakub Breier, Xiaolu Hou arxiv

Embedded neural-network inference can leak information through timing side channels, including leakage caused by the evaluation of activation functions. This work proposes a constant-time implementation methodology for activation functions on embedded microcontrollers and validates it on ReLU, sigmoid, tanh, GELU, and Swish on an ARM Cortex-M4 platform. The proposed methodology combines branchless selection, fixed-cost Padé-based approximation, dummy arithmetic where needed, and cycle alignment to obtain timing-regular activation-function implementations. As motivation, we also evaluate a desynchronization-based countermeasure and show that it remains vulnerable to a template-based timing attack. Experimental results show that the resulting protected implementations achieve identical cycle counts for all tested inputs, including (88) cycles in the three-function setting and (108) cycles in the five-function setting. At the same time, the numerical-error analysis indicates that the approximated nonlinear functions retain high accuracy. These results suggest that the proposed methodology provides a practical basis for constructing side-channel-resistant activation functions in embedded inference.

📄 PDF Abstract BibTeX arXiv:2605.22441

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

[Re] Neural Networks Fail to Learn Periodic Functions and How to Fix It

2021-01-31 · RC 2020 · Mayur Arvind, Mustansir Mama

Scope of Reproducibility Neural Networks Fail to Learn Periodic Functions and How to Fix It [1] demonstrates experimentally that standard activations such as ReLU, tanh, sigmoid and their variants all fail to learn how …

Sentiment Analysis

Efficient Quantum Circuits for Machine Learning Activation Functions including Constant T-depth ReLU

2024-04-09 · Wei Zi, Siyi Wang, Hyunji Kim, Xiaoming Sun 외

In recent years, Quantum Machine Learning (QML) has increasingly captured the interest of researchers. Among the components in this domain, activation functions hold a fundamental and indispensable role. Our research foc…

Quantum Machine Learning

A Logical View of GNN-Style Computation and the Role of Activation Functions

2025-12-22 · Pablo Barceló, Floris Geerts, Matthias Lanzinger, Klara Pakhomenko 외 arxiv

We study the numerical and Boolean expressiveness of MPLang, a declarative language that captures the computation of graph neural networks (GNNs) through linear message passing and activation functions. We begin with A-M…

A Methodology for Automatic Selection of Activation Functions to Design Hybrid Deep Neural Networks

2018-10-27 · Marchisio Alberto, Hanif Muhammad Abdullah, Rehman Semeen, Martina Maurizio 외

Activation functions influence behavior and performance of DNNs. Nonlinear activation functions, like Rectified Linear Units (ReLU), Exponential Linear Units (ELU) and Scaled Exponential Linear Units (SELU), outperform t…

A Neural Network for the Identical Kuramoto Equation: Architectural Considerations and Performance Evaluation

2025-09-17 · Nishantak Panigrahi, Mayank Patwal arxiv

In this paper, we investigate the efficiency of Deep Neural Networks (DNNs) to approximate the solution of a nonlocal conservation law derived from the identical-oscillator Kuramoto model, focusing on the evaluation of a…