paper-with-me

홈 › Papers

Free-Energy-Gated Plasticity for Real-Time Online Motor Learning in Physical Human--Robot Interaction

2026-08-24 · Hiroki Sawada, Jun Tani arxiv

Fully online embodied learning requires synaptic adaptation to acquire new behaviors while preserving previously learned dynamics during ongoing interaction. We extend the Predictive-Coding-inspired Variational Recurrent Neural Network (PV-RNN) to continuously adapt its synaptic weights and propose Free-Energy-Gated Plasticity (FEGP), which regulates the effective learning rate according to variational free energy. In real-time physical human--robot interaction, a randomly initialized network acquired three cyclic motor patterns without offline pretraining, replay, or task-boundary signals, with all three patterns emerging in autonomous rollouts. Controlled experiments over ten randomized teaching streams and five network initializations per stream showed that FEGP substantially improved repertoire coverage and retention of previously acquired patterns after they left the recent observation window. Neither a constant learning rate matched to the gate's time-averaged effective rate nor replay of the same gain values with disrupted temporal organization reproduced these improvements. These results indicate that the temporal allocation of plasticity relative to model--environment mismatch, rather than simply its average magnitude or distribution, is critical for maintaining previously acquired behaviors during continued online learning.

📄 PDF Abstract BibTeX arXiv:2608.23000

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Freezing chaos without synaptic plasticity

2025-03-11 · Weizhong Huang, Haiping Huang

Chaos is ubiquitous in high-dimensional neural dynamics. A strong chaotic fluctuation may be harmful to information processing. A traditional way to mitigate this issue is to introduce Hebbian plasticity, which can stabi…

Metabolic constraints on synaptic learning and memory

2019-10-16

Dendritic spines, the carriers of long-term memory, occupy a small fraction of cortical space, and yet they are the major consumers of brain metabolic energy. What fraction of this energy goes for synaptic plasticity, co…

Burst Synchronization in A Scale-Free Neuronal Network with Inhibitory Spike-Timing-Dependent Plasticity

2018-08-20

We are concerned about burst synchronization (BS), related to neural information processes in health and disease, in the Barab\'{a}si-Albert scale-free network (SFN) composed of inhibitory bursting Hindmarsh-Rose neurons…

Mistake gating leads to energy and memory efficient continual learning

2026-04-15 · Aaron Pache, Mark CW van Rossum arxiv

Synaptic plasticity is metabolically expensive, yet animals continuously update their internal models without exhausting energy reserves. However, when artificial neural networks are trained, the network parameters are t…

Incremental LearningContinual Learning

Competitive plasticity to reduce the energetic costs of learning

2023-04-04 · Mark CW van Rossum

The brain is not only constrained by energy needed to fuel computation, but it is also constrained by energy needed to form memories. Experiments have shown that learning simple conditioning tasks already carries a signi…