Reward-modulated learning using spiking neural networks for vehicle lateral control
This paper presents a vehicle lateral controller based on spiking neural networks capable of replicating the behavior of a model-based controller but with the additional ability to perform online adaptation. By making use of neural plasticity and thanks to reward modulation learning, neural connections are modified to adjust the response according to the committed error. Therefore, the error performs a similar role to dopamine in a biological system, modulating the learning process based on spiking time dependency. The connections are initially set to replicate behavior of the model-based controller. Online adaptation allows tuning connection parameters to improve controller performance. A path controller with a preview is used as a baseline controller to evaluate the performance of the proposed approach. Key performance indicators are obtained from simulation with a step response and a handling track with 20 curves of different radii.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Indirect and Direct Training of Spiking Neural Networks for End-to-End Control of a Lane-Keeping Vehicle
Building spiking neural networks (SNNs) based on biological synaptic plasticities holds a promising potential for accomplishing fast and energy-efficient computing, which is beneficial to mobile robotic applications. How…
Q-LearningReinforcement LearningEMBER: Autonomous Cognitive Behaviour from Learned Spiking Neural Network Dynamics in a Hybrid LLM Architecture
We present (Experience-Modulated Biologically-inspired Emergent Reasoning), a hybrid cognitive architecture that reorganises the relationship between large language models (LLMs) and memory: rather than augmenting an LLM…
BioLCNet: Reward-modulated Locally Connected Spiking Neural Networks
Brain-inspired computation and information processing alongside compatibility with neuromorphic hardware have made spiking neural networks (SNN) a promising method for solving learning tasks in machine learning (ML). Spi…
Decoderimage-classificationImage ClassificationBilateral Deep Reinforcement Learning Approach for Better-than-human Car Following Model
In the coming years and decades, autonomous vehicles (AVs) will become increasingly prevalent, offering new opportunities for safer and more convenient travel and potentially smarter traffic control methods exploiting au…
Autonomous DrivingAutonomous VehiclesDeep Reinforcement LearningMulti-agent Reinforcement Learning+3Reinforcement Learning in a Neurally Controlled Robot Using Dopamine Modulated STDP
Recent work has shown that dopamine-modulated STDP can solve many of the issues associated with reinforcement learning, such as the distal reward problem. Spiking neural networks provide a useful technique in implementin…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)