paper-with-me

Papers

Run-and-tumble chemotaxis using reinforcement learning

2025-01-07 · Ramesh Pramanik, Shradha Mishra, Sakuntala Chatterjee

Bacterial cells use run-and-tumble motion to climb up attractant concentration gradient in their environment. By extending the uphill runs and shortening the downhill runs the cells migrate towards the higher attractant zones. Motivated by this, we formulate a reinforcement learning (RL) algorithm where an agent moves in one dimension in the presence of an attractant gradient. The agent can perform two actions: either persistent motion in the same direction or reversal of direction. We assign costs for these actions based on the recent history of the agent's trajectory. We ask the question: which RL strategy works best in different types of attractant environment. We quantify efficiency of the RL strategy by the ability of the agent (a) to localize in the favorable zones after large times, and (b) to learn about its complete environment. Depending on the attractant profile and the initial condition, we find an optimum balance is needed between exploration and exploitation to ensure the most efficient performance.

📄 PDF Abstract BibTeX arXiv:2501.03687

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Optimal sensing and control of run-and-tumble chemotaxis

2021-06-23 · Kento Nakamura, Tetsuya J. Kobayashi

Run-and-tumble chemotaxis is one of the representative search strategies of an odor source via sensing its spatial gradient. The optimal ways of sensing and control in the run-and-tumble chemotaxis have been analyzed the…

Steady state running rate sets the speed and accuracy of accumulation of swimming bacterial populations

2020-07-16 · Margaritis Voliotis, Jerko Rosko, Teuta Pilizota, Tanniemola Liverpool

We study the chemotaxis of a population of genetically identical swimming bacteria undergoing run and tumble dynamics driven by stochastic switching between clockwise and counterclockwise rotation of the flagellar rotary…

Effect of receptor clustering on chemotactic performance of Escherichia coli: sensing versus adaptation

2020-09-06 · Shobhan Dev Mandal, Sakuntala Chatterjee

We show how the competition between sensing and adaptation can result in a performance peak in E.coli chemotaxis using extensive numerical simulations in a detailed theoretical model. Receptor clustering amplifies the in…

Clustering

A path-integral formulation of the run and tumble motion and chemotaxis in Escherichia coli

2018-02-23

Bacteria such as Escherichia coli move about in a series of runs and tumbles: while a run state (straight motion) entails all the flagellar motors spinning in counterclockwise mode, a tumble is caused by a shift in the s…

Learning optimal integration of spatial and temporal information in noisy chemotaxis

2023-10-16 · Albert Alonso, Julius B. Kirkegaard

We investigate the boundary between chemotaxis driven by spatial estimation of gradients and chemotaxis driven by temporal estimation. While it is well known that spatial chemotaxis becomes disadvantageous for small orga…

Deep Reinforcement Learning