Deep Reinforcement Learning for Real-Time Optimization of Pumps in Water Distribution Systems
Real-time control of pumps can be an infeasible task in water distribution systems (WDSs) because the calculation to find the optimal pump speeds is resource-intensive. The computational need cannot be lowered even with the capabilities of smart water networks when conventional optimization techniques are used. Deep reinforcement learning (DRL) is presented here as a controller of pumps in two WDSs. An agent based on a dueling deep q-network is trained to maintain the pump speeds based on instantaneous nodal pressure data. General optimization techniques (e.g., Nelder-Mead method, differential evolution) serve as baselines. The total efficiency achieved by the DRL agent compared to the best performing baseline is above 0.98, whereas the speedup is around 2x compared to that. The main contribution of the presented approach is that the agent can run the pumps in real-time because it depends only on measurement data. If the WDS is replaced with a hydraulic simulation, the agent still outperforms conventional techniques in search speed.
Code (1)
Tasks
Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
The Pump Scheduling Problem: A Real-World Scenario for Reinforcement Learning
Deep Reinforcement Learning (DRL) has demonstrated impressive results in domains such as games and robotics, where task formulations are well-defined. However, few DRL benchmarks are grounded in complex, real-world envir…
Deep Reinforcement LearningOffline RLreinforcement-learningReinforcement Learning (RL)+2WaterAdmin: Orchestrating Community Water Distribution Optimization via AI Agents
We study the operation of community water systems, where pumps and valves must be scheduled to reliably meet water demands while minimizing energy consumption. While existing optimization-based methods are effective unde…
A Deep Learning Approach for Thermal Plume Prediction of Groundwater Heat Pumps
Climate control of buildings makes up a significant portion of global energy consumption, with groundwater heat pumps providing a suitable alternative. To prevent possibly negative interactions between heat pumps through…
Deep learning based surrogate modeling for thermal plume prediction of groundwater heat pumps
The ability for groundwater heat pumps to meet space heating and cooling demands without relying on fossil fuels, has prompted their mass roll out in dense urban environments. In regions with high subsurface groundwater …
Cyber Physical Aquaponic System (CyPhA): a CPS Testbed
Aquaponics system promises a sustainable urban development and food production by combining vegetable and fish farming in a single water loop. However, traditional aquaponics suffers from a significant amount of manual i…
Decision Making