Emergence of Chemotactic Strategies with Multi-Agent Reinforcement Learning

2024-04-02 · Samuel Tovey, Christoph Lohrmann, Christian Holm

Reinforcement learning (RL) is a flexible and efficient method for programming micro-robots in complex environments. Here we investigate whether reinforcement learning can provide insights into biological systems when trained to perform chemotaxis. Namely, whether we can learn about how intelligent agents process given information in order to swim towards a target. We run simulations covering a range of agent shapes, sizes, and swim speeds to determine if the physical constraints on biological swimmers, namely Brownian motion, lead to regions where reinforcement learners' training fails. We find that the RL agents can perform chemotaxis as soon as it is physically possible and, in some cases, even before the active swimming overpowers the stochastic environment. We study the efficiency of the emergent policy and identify convergence in agent size and swim speeds. Finally, we study the strategy adopted by the reinforcement learning algorithm to explain how the agents perform their tasks. To this end, we identify three emerging dominant strategies and several rare approaches taken. These strategies, whilst producing almost identical trajectories in simulation, are distinct and give insight into the possible mechanisms behind which biological agents explore their environment and respond to changing conditions.

📄 PDF Abstract BibTeX arXiv:2404.01999

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Chemotaxis of sea urchin sperm cells through deep reinforcement learning

2022-08-02 · Chaojie Mo, Xin Bian

By imitating biological microswimmers, microrobots can be designed to accomplish targeted delivery of cargos and biomedical manipulations at microscale. However, it is still a great challenge to enable microrobots to man…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Learning optimal integration of spatial and temporal information in noisy chemotaxis

2023-10-16 · Albert Alonso, Julius B. Kirkegaard

We investigate the boundary between chemotaxis driven by spatial estimation of gradients and chemotaxis driven by temporal estimation. While it is well known that spatial chemotaxis becomes disadvantageous for small orga…

Deep Reinforcement Learning

Emergent collective intelligence from massive-agent cooperation and competition

2023-01-04 · HanMo Chen, Stone Tao, Jiaxin Chen, Weihan Shen 외

Inspired by organisms evolving through cooperation and competition between different populations on Earth, we study the emergence of artificial collective intelligence through massive-agent reinforcement learning. To thi…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Principles of efficient chemotactic pursuit

2019-02-27

In chemotaxis, cells are modulating their migration patterns in response to concentration gradients of a guiding substance. Immune cells are believed to use such chemotactic sensing for remotely detecting and homing in o…

Natural Emergence of Heterogeneous Strategies in Artificially Intelligent Competitive Teams

2020-07-06 · Ankur Deka, Katia Sycara

Multi agent strategies in mixed cooperative-competitive environments can be hard to craft by hand because each agent needs to coordinate with its teammates while competing with its opponents. Learning based algorithms ar…