Deep Reinforcement Learning for Neural Control

2020-06-12 · Jimin Kim, Eli Shlizerman

We present a novel methodology for control of neural circuits based on deep reinforcement learning. Our approach achieves aimed behavior by generating external continuous stimulation of existing neural circuits (neuromodulation control) or modulations of neural circuits architecture (connectome control). Both forms of control are challenging due to nonlinear and recurrent complexity of neural activity. To infer candidate control policies, our approach maps neural circuits and their connectome into a grid-world like setting and infers the actions needed to achieve aimed behavior. The actions are inferred by adaptation of deep Q-learning methods known for their robust performance in navigating grid-worlds. We apply our approach to the model of \textit{C. elegans} which simulates the full somatic nervous system with muscles and body. Our framework successfully infers neuropeptidic currents and synaptic architectures for control of chemotaxis. Our findings are consistent with in vivo measurements and provide additional insights into neural control of chemotaxis. We further demonstrate the generality and scalability of our methods by inferring chemotactic neural circuits from scratch.

📄 PDF Abstract BibTeX arXiv:2006.07352

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Model-Reference Reinforcement Learning Control of Autonomous Surface Vehicles with Uncertainties

2020-03-30 · Qingrui Zhang, Wei Pan, Vasso Reppa

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. W…

Autonomous Vehicles Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Quantum Control based on Deep Reinforcement Learning

2022-12-14 · Zhikang Wang

In this thesis, we consider two simple but typical control problems and apply deep reinforcement learning to them, i.e., to cool and control a particle which is subject to continuous position measurement in a one-dimensi…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles

2020-08-17 · Qingrui Zhang, Wei Pan, Vasso Reppa

This paper presents a novel model-reference reinforcement learning algorithm for the intelligent tracking control of uncertain autonomous surface vehicles with collision avoidance. The proposed control algorithm combines…

Collision Avoidance Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Deep Reinforcement Learning for Time Optimal Velocity Control using Prior Knowledge

2018-11-28 · Gabriel Hartmann, Zvi Shiller, Amos Azaria

Autonomous navigation has recently gained great interest in the field of reinforcement learning. However, little attention was given to the time optimal velocity control problem, i.e. controlling a vehicle such that it t…

Autonomous Navigation Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Aiding reinforcement learning for set point control

2023-04-20 · Ruoqi Zhang, Per Mattsson, Torbjörn Wigren

While reinforcement learning has made great improvements, state-of-the-art algorithms can still struggle with seemingly simple set-point feedback control problems. One reason for this is that the learned controller may n…

reinforcement-learning Reinforcement Learning