paper-with-me

홈 › Papers

FFGAF-SNN: The Forward-Forward Based Gradient Approximation Free Training Framework for Spiking Neural Networks

2025-07-31 · Changqing Xu, Ziqiang Yang, Yi Liu, Xinfang Liao, Guiqi Mo, Hao Zeng, Yintang Yang arxiv

Spiking Neural Networks (SNNs) offer a biologically plausible framework for energy-efficient neuromorphic computing. However, it is a challenge to train SNNs due to their non-differentiability, efficiently. Existing gradient approximation approaches frequently sacrifice accuracy and face deployment limitations on edge devices due to the substantial computational requirements of backpropagation. To address these challenges, we propose a Forward-Forward (FF) based gradient approximation-free training framework for Spiking Neural Networks, which treats spiking activations as black-box modules, thereby eliminating the need for gradient approximation while significantly reducing computational complexity. Furthermore, we introduce a class-aware complexity adaptation mechanism that dynamically optimizes the loss function based on inter-class difficulty metrics, enabling efficient allocation of network resources across different categories. Experimental results demonstrate that our proposed training framework achieves test accuracies of 99.58%, 92.13%, and 75.64% on the MNIST, Fashion-MNIST, and CIFAR-10 datasets, respectively, surpassing all existing FF-based SNN approaches. Additionally, our proposed method exhibits significant advantages in terms of memory access and computational power consumption.

📄 PDF Abstract BibTeX arXiv:2507.23643

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Differentiable Likelihoods for Fast Inversion of 'Likelihood-Free' Dynamical Systems

2020-02-21 · ICML 2020 1 · Hans Kersting, Nicholas Krämer, Martin Schiegg, Christian Daniel 외

Likelihood-free (a.k.a. simulation-based) inference problems are inverse problems with expensive, or intractable, forward models. ODE inverse problems are commonly treated as likelihood-free, as their forward map has to …

Forward Amortized Inference for Likelihood-Free Variational Marginalization

2018-05-29 · Luca Ambrogioni, Umut Güçlü, Julia Berezutskaya, Eva W. P. van den Borne 외

In this paper, we introduce a new form of amortized variational inference by using the forward KL divergence in a joint-contrastive variational loss. The resulting forward amortized variational inference is a likelihood-…

General ClassificationVariational Inference

Beyond Backpropagation: Optimization with Multi-Tangent Forward Gradients

2024-10-23 · Katharina Flügel, Daniel Coquelin, Marie Weiel, Achim Streit 외

The gradients used to train neural networks are typically computed using backpropagation. While an efficient way to obtain exact gradients, backpropagation is computationally expensive, hinders parallelization, and is bi…

Approximation of forward curve models in commodity markets with arbitrage-free finite dimensional models

2015-12-18

In this paper we show how to approximate a Heath-Jarrow-Morton dynamics for the forward prices in commodity markets with arbitrage-free models which have a finite dimensional state space. Moreover, we recover a closed fo…

Gradients should stay on Path: Better Estimators of the Reverse- and Forward KL Divergence for Normalizing Flows

2022-07-17 · Lorenz Vaitl, Kim A. Nicoli, Shinichi Nakajima, Pan Kessel

We propose an algorithm to estimate the path-gradient of both the reverse and forward Kullback-Leibler divergence for an arbitrary manifestly invertible normalizing flow. The resulting path-gradient estimators are straig…

Variational Inference