Transferring Multiple Policies to Hotstart Reinforcement Learning in an Air Compressor Management Problem

2023-01-30 · Hélène Plisnier, Denis Steckelmacher, Jeroen Willems, Bruno Depraetere, Ann Nowé

Many instances of similar or almost-identical industrial machines or tools are often deployed at once, or in quick succession. For instance, a particular model of air compressor may be installed at hundreds of customers. Because these tools perform distinct but highly similar tasks, it is interesting to be able to quickly produce a high-quality controller for machine $N+1$ given the controllers already produced for machines $1..N$. This is even more important when the controllers are learned through Reinforcement Learning, as training takes time, energy and other resources. In this paper, we apply Policy Intersection, a Policy Shaping method, to help a Reinforcement Learning agent learn to solve a new variant of a compressors control problem faster, by transferring knowledge from several previously learned controllers. We show that our approach outperforms loading an old controller, and significantly improves performance in the long run.

📄 PDF Abstract BibTeX arXiv:2301.12820

Code (0)

등록된 구현이 없습니다.

Tasks

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

MANGA: Method Agnostic Neural-policy Generalization and Adaptation

2019-11-19 · Homanga Bharadhwaj, Shoichiro Yamaguchi, Shin-ichi Maeda

In this paper we target the problem of transferring policies across multiple environments with different dynamics parameters and motor noise variations, by introducing a framework that decouples the processes of policy l…

Imitation Learning MuJoCo Reinforcement Learning Reinforcement Learning (RL)

Multi-robot Cooperative Pursuit via Potential Field-Enhanced Reinforcement Learning

2022-03-09 · Zheng Zhang, Xiaohan Wang, Qingrui Zhang, Tianjiang Hu

It is of great challenge, though promising, to coordinate collective robots for hunting an evader in a decentralized manner purely in light of local observations. In this paper, this challenge is addressed by a novel hyb…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning Curriculum Policies for Reinforcement Learning

2018-12-01 · Sanmit Narvekar, Peter Stone

Curriculum learning in reinforcement learning is a training methodology that seeks to speed up learning of a difficult target task, by first training on a series of simpler tasks and transferring the knowledge acquired t…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Transfer Learning

$P^{3}O$: Transferring Visual Representations for Reinforcement Learning via Prompting

2023-03-22 · Guoliang You, Xiaomeng Chu, Yifan Duan, Jie Peng 외

It is important for deep reinforcement learning (DRL) algorithms to transfer their learned policies to new environments that have different visual inputs. In this paper, we introduce Prompt based Proximal Policy Optimiza…

Deep Reinforcement Learning reinforcement-learning

Similarity-based Knowledge Transfer for Cross-Domain Reinforcement Learning

2023-12-05 · Sergio A. Serrano, Jose Martinez-Carranza, L. Enrique Sucar

Transferring knowledge in cross-domain reinforcement learning is a challenging setting in which learning is accelerated by reusing knowledge from a task with different observation and/or action space. However, it is ofte…

MuJoCo reinforcement-learning Reinforcement Learning Transfer Learning