Learning to swim in potential flow

2020-09-30 · Yusheng Jiao, Feng Ling, Sina Heydari, Nicolas Heess, Josh Merel, Eva Kanso

Fish swim by undulating their bodies. These propulsive motions require coordinated shape changes of a body that interacts with its fluid environment, but the specific shape coordination that leads to robust turning and swimming motions remains unclear. To address the problem of underwater motion planning, we propose a simple model of a three-link fish swimming in a potential flow environment and we use model-free reinforcement learning for shape control. We arrive at optimal shape changes for two swimming tasks: swimming in a desired direction and swimming towards a known target. This fish model belongs to a class of problems in geometric mechanics, known as driftless dynamical systems, which allow us to analyze the swimming behavior in terms of geometric phases over the shape space of the fish. These geometric methods are less intuitive in the presence of drift. Here, we use the shape space analysis as a tool for assessing, visualizing, and interpreting the control policies obtained via reinforcement learning in the absence of drift. We then examine the robustness of these policies to drift-related perturbations. Although the fish has no direct control over the drift itself, it learns to take advantage of the presence of moderate drift to reach its target.

📄 PDF Abstract BibTeX arXiv:2009.14280

Code (1)

mjysh/RL3linkFish 공식 구현 pytorch

Tasks

Motion Planning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Machine learning strategies for path-planning microswimmers in turbulent flows

2019-10-03 · Jaya Kumar Alageshan, Akhilesh Kumar Verma, Jérémie Bec, Rahul Pandit

We develop an adversarial-reinforcement learning scheme for microswimmers in statistically homogeneous and isotropic turbulent fluid flows, in both two (2D) and three dimensions (3D). We show that this scheme allows micr…

BIG-bench Machine Learning Position Reinforcement Learning Reinforcement Learning (RL)

Flow Navigation by Smart Microswimmers via Reinforcement Learning

2017-01-30 · Simona Colabrese, Kristian Gustavsson, Antonio Celani, Luca Biferale

Smart active particles can acquire some limited knowledge of the fluid environment from simple mechanical cues and exert a control on their preferred steering direction. Their goal is to learn the best way to navigate by…

Navigate reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning to swim efficiently in a nonuniform flow field

2022-12-22 · Krongtum Sankaewtong, John J. Molina, Matthew S. Turner, Ryoichi Yamamoto

Microswimmers can acquire information on the surrounding fluid by sensing mechanical queues. They can then navigate in response to these signals. We analyse this navigation by combining deep reinforcement learning with d…

Deep Reinforcement Learning Navigate

Flagellar swimmers oscillate between pusher- and puller-type swimming

2015-04-22

Self-propulsion of cellular microswimmers generates flow signatures, commonly classified as pusher- and puller-type, which characterize hydrodynamic interactions with other cells or boundaries. Using experimentally measu…

Vocal Bursts Type Prediction

Learning swimming escape patterns for larval fish under energy constraints

2021-05-03 · Ioannis Mandralis, Pascal Weber, Guido Novati, Petros Koumoutsakos

Swimming organisms can escape their predators by creating and harnessing unsteady flow fields through their body motions. Stochastic optimization and flow simulations have identified escape patterns that are consistent w…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Stochastic Optimization