Run-and-tumble chemotaxis using reinforcement learning
Bacterial cells use run-and-tumble motion to climb up attractant concentration gradient in their environment. By extending the uphill runs and shortening the downhill runs the cells migrate towards the higher attractant zones. Motivated by this, we formulate a reinforcement learning (RL) algorithm where an agent moves in one dimension in the presence of an attractant gradient. The agent can perform two actions: either persistent motion in the same direction or reversal of direction. We assign costs for these actions based on the recent history of the agent's trajectory. We ask the question: which RL strategy works best in different types of attractant environment. We quantify efficiency of the RL strategy by the ability of the agent (a) to localize in the favorable zones after large times, and (b) to learn about its complete environment. Depending on the attractant profile and the initial condition, we find an optimum balance is needed between exploration and exploitation to ensure the most efficient performance.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Optimal sensing and control of run-and-tumble chemotaxis
Run-and-tumble chemotaxis is one of the representative search strategies of an odor source via sensing its spatial gradient. The optimal ways of sensing and control in the run-and-tumble chemotaxis have been analyzed the…
Steady state running rate sets the speed and accuracy of accumulation of swimming bacterial populations
We study the chemotaxis of a population of genetically identical swimming bacteria undergoing run and tumble dynamics driven by stochastic switching between clockwise and counterclockwise rotation of the flagellar rotary…
Effect of receptor clustering on chemotactic performance of Escherichia coli: sensing versus adaptation
We show how the competition between sensing and adaptation can result in a performance peak in E.coli chemotaxis using extensive numerical simulations in a detailed theoretical model. Receptor clustering amplifies the in…
ClusteringA path-integral formulation of the run and tumble motion and chemotaxis in Escherichia coli
Bacteria such as Escherichia coli move about in a series of runs and tumbles: while a run state (straight motion) entails all the flagellar motors spinning in counterclockwise mode, a tumble is caused by a shift in the s…
Learning optimal integration of spatial and temporal information in noisy chemotaxis
We investigate the boundary between chemotaxis driven by spatial estimation of gradients and chemotaxis driven by temporal estimation. While it is well known that spatial chemotaxis becomes disadvantageous for small orga…
Deep Reinforcement Learning