paper-with-me

홈 › Papers

Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning

2026-05-11 · Salar Beigzad, Vansh Verma arxiv

We propose Adaptive Multi-Scale Goodness Aggregation (AMSGA), a novel extension of the Forward-Forward (FF) algorithm designed to improve stability, robustness, and generalization in local-learning neural networks. AMSGA addresses several limitations of the original FF framework by introducing multi-scale goodness aggregation across local, intermediate, and global representations; adaptive curriculum-guided hard negative mining; layer-dependent adaptive thresholds; and a warm-up cosine annealing learning-rate schedule for improved optimization stability. Together, these modifications strengthen the FF paradigm while preserving its biologically plausible and memory-efficient properties. Experiments on MNIST and Fashion-MNIST demonstrate consistent performance improvements over the baseline FF algorithm, achieving up to +1.45% improvement on MNIST and +1.50% improvement on Fashion-MNIST without significant computational overhead. Our results suggest that local learning methods can become substantially more competitive when goodness estimation and training dynamics are carefully designed.

📄 PDF Abstract BibTeX arXiv:2605.18804

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

What Does Goodness Measure? A Likelihood-Ratio Account of Forward-Forward Learning

2026-07-14 · Paolo Giannitrapani arxiv

The Forward-Forward (FF) algorithm trains each layer locally, so that a scalar goodness - the sum of squared activations - is high on real inputs and low on contrastive ones, with activations normalized between layers. B…

Covariance-Aware Goodness for Scalable Forward-Forward Learning

2026-05-05 · Xiaoyi Jiang, Bashir M. Al-Hashimi, Kai Xu arxiv

The Forward-Forward algorithm eliminates global gradient flow and full network activations storage. However, in convolutional settings, existing BP-free FF methods significantly under-perform backpropagation on complex b…

Adaptive Spatial Goodness Encoding: Advancing and Scaling Forward-Forward Learning Without Backpropagation

2025-09-15 · Qingchun Gong, Robert Bogdan Staszewski, Kai Xu arxiv

The Forward-Forward (FF) algorithm offers a promising alternative to backpropagation (BP). Despite advancements in recent FF-based extensions, which have enhanced the original algorithm and adapted it to convolutional ne…

FFR: Forward-Forward Learning for Regression

2026-06-02 · Xinyang Liu, Xuanyu Liang, Shiqi Ding, Boyang Li 외 arxiv

The Forward-Forward (FF) algorithm offers a computationally efficient and biologically plausible alternative to backpropagation (BP) by training neural networks through purely local, layer-wise optimization. However, FF …

Contrastive Learning

Selectivity and Shape in the Design of Forward-Forward Goodness Functions

2026-03-28 · Talha Ruzgar Akkus, Suayp Talha Kocabay, Kamer Ali Yuksel, Hassan Sawaf arxiv

The Forward-Forward (FF) algorithm trains networks layer-by-layer using a local "goodness function," yet sum-of-squares (SoS) has remained the only choice studied. We systematically explore the goodness-function design s…