Sequential Multi-objective Multi-agent Reinforcement Learning Approach for Predictive Maintenance

2025-02-04 · Yan Chen, Cheng Liu

Existing predictive maintenance (PdM) methods typically focus solely on whether to replace system components without considering the costs incurred by inspection. However, a well-considered approach should be able to minimize Remaining Useful Life (RUL) at engine replacement while maximizing inspection interval. To achieve this, multi-agent reinforcement learning (MARL) can be introduced. However, due to the sequential and mutually constraining nature of these 2 objectives, conventional MARL is not applicable. Therefore, this paper introduces a novel framework and develops a Sequential Multi-objective Multi-agent Proximal Policy Optimization (SMOMA-PPO) algorithm. Furthermore, to provide comprehensive and effective degradation information to RL agents, we also employed Gated Recurrent Unit, quantile regression, and probability distribution fitting to develop a GRU-based RUL Prediction (GRP) model. Experiments demonstrate that the GRP method significantly improves the accuracy of RUL predictions in the later stages of system operation compared to existing methods. When incorporating its output into SMOMA-PPO, we achieve at least a 15% reduction in average RUL without unscheduled replacements (UR), nearly a 10% increase in inspection interval, and an overall decrease in maintenance costs. Importantly, our approach offers a new perspective for addressing multi-objective maintenance planning with sequential constraints, effectively enhancing system reliability and reducing maintenance expenses.

📄 PDF Abstract BibTeX arXiv:2502.02071

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement LearningMulti-Objective Multi-Agent Reinforcement Learningquantile regression

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Low Variance Trust Region Optimization with Independent Actors and Sequential Updates in Cooperative Multi-agent Reinforcement Learning

2026-06-24 · Bang Giang Le, Viet Cuong Ta arxiv

Cooperative multi-agent reinforcement learning assumes each agent shares the same reward function and can be trained effectively using the Trust Region framework of single-agent. Instead of relying on other agents' actio…

Multi-agent Reinforcement Learning

Exploring the Impact of Tunable Agents in Sequential Social Dilemmas

2021-01-28 · David O'Callaghan, Patrick Mannion

When developing reinforcement learning agents, the standard approach is to train an agent to converge to a fixed policy that is as close to optimal as possible for a single fixed reward function. If different agent behav…

Multi-Objective Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Scale-Independent Multi-Objective Reinforcement Learning with Convergence Analysis

2023-02-08 · Mohsen Amidzadeh

Many sequential decision-making problems need optimization of different objectives which possibly conflict with each other. The conventional way to deal with a multi-task problem is to establish a scalar objective functi…

Decision Making Multi-Objective Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Coevolving with the Other You: Fine-Tuning LLM with Sequential Cooperative Multi-Agent Reinforcement Learning

2024-10-08 · Hao Ma, Tianyi Hu, Zhiqiang Pu, Boyin Liu 외

Reinforcement learning (RL) has emerged as a pivotal technique for fine-tuning large language models (LLMs) on specific tasks. However, prevailing RL fine-tuning methods predominantly rely on PPO and its variants. Though…

GSM8K Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Hierarchical Lead Critic based Multi-Agent Reinforcement Learning

2026-02-25 · David Eckel, Henri Meeß arxiv

Cooperative Multi-Agent Reinforcement Learning (MARL) solves complex tasks that require coordination from multiple agents, but is often limited to either local (independent learning) or global (centralized learning) pers…