A model of reward-modulated motor learning with parallelcortical and basal ganglia pathways

2018-03-08 · Ryan Pyle, Robert Rosenbaum

Many recent studies of the motor system are divided into two distinct approaches: Those that investigate how motor responses are encoded in cortical neurons' firing rate dynamics and those that study the learning rules by which mammals and songbirds develop reliable motor responses. Computationally, the first approach is encapsulated by reservoir computing models, which can learn intricate motor tasks and produce internal dynamics strikingly similar to those of motor cortical neurons, but rely on biologically unrealistic learning rules. The more realistic learning rules developed by the second approach are often derived for simplified, discrete tasks in contrast to the intricate dynamics that characterize real motor responses. We bridge these two approaches to develop a biologically realistic learning rule for reservoir computing. Our algorithm learns simulated motor tasks on which previous reservoir computing algorithms fail, and reproduces experimental findings including those that relate motor learning to Parkinson's disease and its treatment.

📄 PDF Abstract BibTeX arXiv:1803.03304

Code (0)

등록된 구현이 없습니다.

The external pallidum: think locally, act globally

2021-04-21 · Connor D. Courtney, Arin Pamukcu, C. Savio Chan

The globus pallidus (GPe) of the basal ganglia has been underappreciated for decades due to poor understanding of its cells and circuits. The advent of molecular tools has sparked a resurgence in interest in the GPe. Her…

Diversity

Action-modulated midbrain dopamine activity arises from distributed control policies

2022-07-01 · Jack Lindsey, Ashok Litwin-Kumar

Animal behavior is driven by multiple brain regions working in parallel with distinct control policies. We present a biologically plausible model of off-policy reinforcement learning in the basal ganglia, which enables l…

Q-Learning reinforcement-learning Reinforcement Learning (RL)

A Computational Model of Representation Learning in the Brain Cortex, Integrating Unsupervised and Reinforcement Learning

2021-06-07 · Giovanni Granato, Emilio Cartoni, Federico Da Rold, Andrea Mattera 외

A common view on the brain learning processes proposes that the three classic learning paradigms -- unsupervised, reinforcement, and supervised -- take place in respectively the cortex, the basal-ganglia, and the cerebel…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Representation Learning

A Spiking Neural Architecture for Coordinating Arm and Locomotor Control

2026-06-09 · Lea Steffen, Kathryn Simone, Graeme Damberger, Travis DeWolf 외 arxiv

Spiking Neural Networks (SNNs) coupled with neuromorphic hardware offer energy-efficient solutions for humanoid robot control. However, existing SNN-based motor control systems address bipedal locomotion and arm control …

Threshold Learning for Optimal Decision Making

2016-12-01 · NeurIPS 2016 12 · Nathan F. Lepora

Decision making under uncertainty is commonly modelled as a process of competitive stochastic evidence accumulation to threshold (the drift-diffusion model). However, it is unknown how animals learn these decision thresh…

Bayesian Optimization Decision Making Decision Making Under Uncertainty