An Architecture for Deploying Reinforcement Learning in Industrial Environments

2023-06-02 · Georg Schäfer, Reuf Kozlica, Stefan Wegenkittl, Stefan Huber

Industry 4.0 is driven by demands like shorter time-to-market, mass customization of products, and batch size one production. Reinforcement Learning (RL), a machine learning paradigm shown to possess a great potential in improving and surpassing human level performance in numerous complex tasks, allows coping with the mentioned demands. In this paper, we present an OPC UA based Operational Technology (OT)-aware RL architecture, which extends the standard RL setting, combining it with the setting of digital twins. Moreover, we define an OPC UA information model allowing for a generalized plug-and-play like approach for exchanging the RL agent used. In conclusion, we demonstrate and evaluate the architecture, by creating a proof of concept. By means of solving a toy example, we show that this architecture can be used to determine the optimal policy using a real control system.

📄 PDF Abstract BibTeX arXiv:2306.01420

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

The Challenges of Using Reinforcement Learning for Controlling Industrial Energy Systems

2026-05-29 · Tobias Lademann, Théo Vincent, Jan Peters, Matthias Weigold arxiv

Reinforcement learning has shown promising results for optimizing the control of industrial energy systems, yet most existing studies remain limited to the application in simulation environments. We investigate the chall…

Reinforcement Learning

Towards an MLOps Architecture for XAI in Industrial Applications

2023-09-22 · Leonhard Faubel, Thomas Woudsma, Leila Methnani, Amir Ghorbani Ghezeljhemeidan 외

Machine learning (ML) has become a popular tool in the industrial sector as it helps to improve operations, increase efficiency, and reduce costs. However, deploying and managing ML models in production environments can …

Management

HiL-ResRL: A Model-Agnostic Finetuning Adapter via Human-in-the-loop Residual Reinforcement Learning

2026-06-22 · Jingyi Liu, Zhaohong Mai, ShunSen He, Hang Ren 외 arxiv

Recent advancements in generative imitation learning have significantly propelled the field of robotic manipulation. However, the majority of existing models rely heavily on Behavior Cloning (BC), a paradigm that suffers…

Reinforcement Learning

MAPPER: Multi-Agent Path Planning with Evolutionary Reinforcement Learning in Mixed Dynamic Environments

2020-07-30 · Zuxin Liu, Baiming Chen, Hongyi Zhou, Guru Koushik 외

Multi-agent navigation in dynamic environments is of great industrial value when deploying a large scale fleet of robot to real-world applications. This paper proposes a decentralized partially observable multi-agent pat…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Federated Learning framework for LoRaWAN-enabled IIoT communication: A case study

2024-10-15 · Oscar Torres Sanchez, Guilherme Borges, Duarte Raposo, André Rodrigues 외

The development of intelligent Industrial Internet of Things (IIoT) systems promises to revolutionize operational and maintenance practices, driving improvements in operational efficiency. Anomaly detection within IIoT a…

Anomaly Detection Federated Learning