paper-with-me

Papers

Making Reinforcement Learning Work on Swimmer

2022-08-16 · Maël Franceschetti, Coline Lacoux, Ryan Ohouens, Antonin Raffin, Olivier Sigaud

The SWIMMER environment is a standard benchmark in reinforcement learning (RL). In particular, it is often used in papers comparing or combining RL methods with direct policy search methods such as genetic algorithms or evolution strategies. A lot of these papers report poor performance on SWIMMER from RL methods and much better performance from direct policy search methods. In this technical report we show that the low performance of RL methods on SWIMMER simply comes from the inadequate tuning of an important hyper-parameter, the discount factor. Furthermore we show that, by setting this hyper-parameter to a correct value, the issue can be easily fixed. Finally, for a set of often used RL algorithms, we provide a set of successful hyper-parameters obtained with the Stable Baselines3 library and its RL Zoo.

📄 PDF Abstract BibTeX arXiv:2208.07587

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Library 설명 없음

Similar Papers 제목 키워드 기반

Deep reinforcement learning for tracking a moving target in jellyfish-like swimming

2024-09-13 · Yihao Chen, Yue Yang

We develop a deep reinforcement learning method for training a jellyfish-like swimmer to effectively track a moving target in a two-dimensional flow. This swimmer is a flexible object equipped with a muscle model based o…

Deep Reinforcement LearningNavigate

Machine learning strategies for path-planning microswimmers in turbulent flows

2019-10-03 · Jaya Kumar Alageshan, Akhilesh Kumar Verma, Jérémie Bec, Rahul Pandit

We develop an adversarial-reinforcement learning scheme for microswimmers in statistically homogeneous and isotropic turbulent fluid flows, in both two (2D) and three dimensions (3D). We show that this scheme allows micr…

BIG-bench Machine LearningPositionReinforcement LearningReinforcement Learning (RL)

Flow Navigation by Smart Microswimmers via Reinforcement Learning

2017-01-30 · Simona Colabrese, Kristian Gustavsson, Antonio Celani, Luca Biferale

Smart active particles can acquire some limited knowledge of the fluid environment from simple mechanical cues and exert a control on their preferred steering direction. Their goal is to learn the best way to navigate by…

Navigatereinforcement-learningReinforcement LearningReinforcement Learning (RL)

Learning to swim efficiently in a nonuniform flow field

2022-12-22 · Krongtum Sankaewtong, John J. Molina, Matthew S. Turner, Ryoichi Yamamoto

Microswimmers can acquire information on the surrounding fluid by sensing mechanical queues. They can then navigate in response to these signals. We analyse this navigation by combining deep reinforcement learning with d…

Deep Reinforcement LearningNavigate

Optimizing Metachronal Paddling with Reinforcement Learning at Low Reynolds Number

2025-07-24 · Alana A. Bailey, Robert D. Guy arxiv

Metachronal paddling is a swimming strategy in which an organism oscillates sets of adjacent limbs with a constant phase lag, propagating a metachronal wave through its limbs and propelling it forward. This limb coordina…

Reinforcement Learning