The Integrated Forward-Forward Algorithm: Integrating Forward-Forward and Shallow Backpropagation With Local Losses

2023-05-22 · Desmond Y. M. Tang

The backpropagation algorithm, despite its widespread use in neural network learning, may not accurately emulate the human cortex's learning process. Alternative strategies, such as the Forward-Forward Algorithm (FFA), offer a closer match to the human cortex's learning characteristics. However, the original FFA paper and related works on the Forward-Forward Algorithm only mentioned very limited types of neural network mechanisms and may limit its application and effectiveness. In response to these challenges, we propose an integrated method that combines the strengths of both FFA and shallow backpropagation, yielding a biologically plausible neural network training algorithm which can also be applied to various network structures. We applied this integrated approach to the classification of the Modified National Institute of Standards and Technology (MNIST) database, where it outperformed FFA and demonstrated superior resilience to noise compared to backpropagation. We show that training neural networks with the Integrated Forward-Forward Algorithm has the potential of generating neural networks with advantageous features like robustness.

📄 PDF Abstract BibTeX arXiv:2305.12960

Code (0)

등록된 구현이 없습니다.

A Simple Recipe to Meta-Learn Forward and Backward Transfer

2023-01-01 · ICCV 2023 1 · Edoardo Cetin, Antonio Carta, Oya Celiktutan

Meta-learning holds the potential to provide a general and explicit solution to tackle interference and forgetting in continual learning. However, many popular algorithms introduce expensive and unstable optimization…

Continual Learning Meta-Learning

PACER: A Fully Push-forward-based Distributional Reinforcement Learning Algorithm

2023-06-11 · Wensong Bai, Chao Zhang, Yichao Fu, Peilin Zhao 외

In this paper, we propose the first fully push-forward-based distributional reinforcement learning algorithm, named PACER, which consists of a distributional critic, a stochastic actor and a sample-based encourager. Spec…

Continuous Control Distributional Reinforcement Learning Efficient Exploration reinforcement-learning+1

FORK: A Forward-Looking Actor For Model-Free Reinforcement Learning

2020-10-04 · Honghao Wei, Lei Ying

In this paper, we propose a new type of Actor, named forward-looking Actor or FORK for short, for Actor-Critic algorithms. FORK can be easily integrated into a model-free Actor-Critic algorithm. Our experiments on six Bo…

GPU MuJoCo reinforcement-learning Reinforcement Learning+1

AnyStyle: Single-Pass Multimodal Stylization for 3D Gaussian Splatting

2026-02-03 · Joanna Kaleta, Bartosz Świrta, Kacper Kania, Przemysław Spurek 외 arxiv

The growing demand for rapid and scalable 3D asset creation has driven interest in feed-forward 3D reconstruction methods, with 3D Gaussian Splatting (3DGS) emerging as an effective scene representation. While recent app…

3D Reconstruction

Forward-Only Convolutional Neural Networks with Learnable Channel-Class Assignment

2026-06-07 · Mohammadnavid Ghader, Saeed Reza Kheradpisheh, Bahar Farahani, Mahmood Fazlali arxiv

The Forward-Forward (FF) algorithm offers a biologically inspired alternative to backpropagation by replacing gradient-based credit assignment with local, forward-only objectives. While recent extensions have adapted FF …