paper-with-me

홈 › Papers

HCL-FF: Hierarchical and Contrastive Learning for Forward-Forward Algorithm

2026-05-24 · Jie-En Yao, Hong-En Chen, C. -C. Jay Kuo arxiv

Deep neural networks trained with backpropagation have achieved outstanding performance in vision tasks but remain biologically implausible, computationally demanding, and difficult to interpret. The Forward-Forward (FF) algorithm offers a promising alternative by training each layer independently through local goodness objectives. However, its purely local optimization lacks hierarchical coordination across layers, and the decoupling of goodness from features leaves the representations unconstrained and semantically ambiguous. We propose a Hierarchical and Contrastive Learning FF framework (HCL-FF) to address these limitations. HCL-FF introduces (1) a coarse-to-fine hierarchical learning strategy that guides representations from low-level cues to high-level semantics, and (2) a supervised contrastive objective that enforces class-discriminative alignment after goodness decoupling. Experiments on CIFAR-10, CIFAR-100, and Tiny-ImageNet demonstrate that HCL-FF achieves new state-of-the-art performance among FF-based methods, with notable accuracy gains of +5.46%, +17.00%, and +12.51%, respectively.

📄 PDF Abstract BibTeX arXiv:2605.24797

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive Learning

Similar Papers 제목 키워드 기반

FFR: Forward-Forward Learning for Regression

2026-06-02 · Xinyang Liu, Xuanyu Liang, Shiqi Ding, Boyang Li 외 arxiv

The Forward-Forward (FF) algorithm offers a computationally efficient and biologically plausible alternative to backpropagation (BP) by training neural networks through purely local, layer-wise optimization. However, FF …

Contrastive Learning

Contrastive Forward-Forward: A Training Algorithm of Vision Transformer

2025-02-01 · Hossein Aghagolzadeh, Mehdi Ezoji

Although backpropagation is widely accepted as a training algorithm for artificial neural networks, researchers are always looking for inspiration from the brain to find ways with potentially better performance. Forward-…

Contrastive Learningimage-classificationImage Classification

Self-Contrastive Forward-Forward Algorithm

2024-09-17 · Xing Chen, Dongshu Liu, jeremie Laydevant, Julie Grollier

Agents that operate autonomously benefit from lifelong learning capabilities. However, compatible training algorithms must comply with the decentralized nature of these systems, which imposes constraints on both the para…

Contrastive LearningLifelong learning

Forward-Forward Contrastive Learning

2023-05-04 · Md. Atik Ahamed, Jin Chen, Abdullah-Al-Zubaer Imran

Medical image classification is one of the most important tasks for computer-aided diagnosis. Deep learning models, particularly convolutional neural networks, have been successfully used for disease classification from …

ClassificationContrastive Learningimage-classificationImage Classification+1

A Contrastive Symmetric Forward-Forward Algorithm (SFFA) for Continual Learning Tasks

2024-09-11 · Erik B. Terres-Escudero, Javier Del Ser, Pablo Garcia Bringas

The so-called Forward-Forward Algorithm (FFA) has recently gained momentum as an alternative to the conventional back-propagation algorithm for neural network learning, yielding competitive performance across various mod…

Continual Learningimage-classificationImage Classification