paper-with-me

홈 › Papers

Multi-Year Maintenance Planning for Large-Scale Infrastructure Systems: A Novel Network Deep Q-Learning Approach

2025-07-24 · Amir Fard, Arnold X. -X. Yuan arxiv

Infrastructure asset management is essential for sustaining the performance of public infrastructure such as road networks, bridges, and utility networks. Traditional maintenance and rehabilitation planning methods often face scalability and computational challenges, particularly for large-scale networks with thousands of assets under budget constraints. This paper presents a novel deep reinforcement learning (DRL) framework that optimizes asset management strategies for large infrastructure networks. By decomposing the network-level Markov Decision Process (MDP) into individual asset-level MDPs while using a unified neural network architecture, the proposed framework reduces computational complexity, improves learning efficiency, and enhances scalability. The framework directly incorporates annual budget constraints through a budget allocation mechanism, ensuring maintenance plans are both optimal and cost-effective. Through a case study on a large-scale pavement network of 68,800 segments, the proposed DRL framework demonstrates significant improvements over traditional methods like Progressive Linear Programming and genetic algorithms, both in efficiency and network performance. This advancement contributes to infrastructure asset management and the broader application of reinforcement learning in complex, large-scale environments.

📄 PDF Abstract BibTeX arXiv:2507.18732

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Matheuristics to optimize refueling and maintenance planning of nuclear power plants

2018-12-13 · Nicolas Dupin, El-Ghazali Talbi

Planning the maintenance of nuclear power plants is a complex optimization problem, involving a joint optimization of maintenance dates, fuel constraints and power production decisions. This paper investigates Mixed Inte…

Hierarchical Deep Reinforcement Learning Framework for Multi-Year Asset Management Under Budget Constraints

2025-07-25 · Amir Fard, Arnold X. -X. Yuan arxiv

Budget planning and maintenance optimization are crucial for infrastructure asset management, ensuring cost-effectiveness and sustainability. However, the complexity arising from combinatorial action spaces, diverse asse…

Reinforcement Learning

A deep reinforcement learning model for predictive maintenance planning of road assets: Integrating LCA and LCCA

2021-12-20 · Moein Latifi, Fateme Golivand Darvishvand, Omid Khandel, Mobin Latifi Nowsoud

Road maintenance planning is an integral part of road asset management. One of the main challenges in Maintenance and Rehabilitation (M&R) practices is to determine maintenance type and timing. This research proposes a f…

Asset ManagementDeep Reinforcement LearningManagementReinforcement Learning (RL)

Post Prognostic Decision for Predictive Maintenance Planning with Remaining Useful Life Uncertainty

2020-05-01 · 2020 Prognostics and Health Management Conference (PHM-Besançon) 2020 5 · Khaled Benaggoune, Safa Meraghni, Jian Ma, L.H MOUSS 외

This paper investigates the use of the Particle Swarm Optimization (PSO) algorithm to quantify the effect of RUL uncertainty on predictive maintenance planning. The prediction of RUL is influenced by many sources of unce…

Conflict-Free Four-Dimensional Path Planning for Urban Air Mobility Considering Airspace Occupations

2021-07-27 · Wei Dai, Bizhao Pang, Kin Huat Low

Urban air mobility (UAM) has attracted the attention of aircraft manufacturers, air navigation service providers and governments in recent years. Preventing the conflict among urban aircraft is crucial to UAM traffic saf…

Management