Deep Learning Based Simulators for the Phosphorus Removal Process Control in Wastewater Treatment via Deep Reinforcement Learning Algorithms
Phosphorus removal is vital in wastewater treatment to reduce reliance on limited resources. Deep reinforcement learning (DRL) is a machine learning technique that can optimize complex and nonlinear systems, including the processes in wastewater treatment plants, by learning control policies through trial and error. However, applying DRL to chemical and biological processes is challenging due to the need for accurate simulators. This study trained six models to identify the phosphorus removal process and used them to create a simulator for the DRL environment. Although the models achieved high accuracy (>97%), uncertainty and incorrect prediction behavior limited their performance as simulators over longer horizons. Compounding errors in the models' predictions were identified as one of the causes of this problem. This approach for improving process control involves creating simulation environments for DRL algorithms, using data from supervisory control and data acquisition (SCADA) systems with a sufficient historical horizon without complex system modeling or parameter estimation.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement Learningparameter estimationSimilar Papers 제목 키워드 기반
Application of Soft Actor-Critic Algorithms in Optimizing Wastewater Treatment with Time Delays Integration
Wastewater treatment plants face unique challenges for process control due to their complex dynamics, slow time constants, and stochastic delays in observations and actions. These characteristics make conventional contro…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningWastewater Treatment Plant Data for Nutrient Removal System
This paper introduces the Agtrup (BlueKolding) dataset, collected from Denmark's Agtrup wastewater treatment plant, specifically designed to enhance phosphorus removal via chemical and biological methods. This rich datas…
Deep Reinforcement LearningManagementConstructed wetlands operated as bioelectrochemical systems for the removal of organic micropollutants
The removal of organic micropollutants (OMPs) has been investigated in constructed wetlands (CWs) operated as bioelectrochemical systems (BES). The operation of CWs as BES (CW-BES), either in the form of microbial fuel c…
Improved Long Short-Term Memory-based Wastewater Treatment Simulators for Deep Reinforcement Learning
Even though Deep Reinforcement Learning (DRL) showed outstanding results in the fields of Robotics and Games, it is still challenging to implement it in the optimization of industrial processes like wastewater treatment.…
Deep Reinforcement LearningDynamic Time WarpingSelection of cyanobacteria over green algae in a photo-sequencing batch bioreactor fed with wastewater
A strategy based on photo sequencing batch operation was used to select cyanobacteria over unsettled green algae in a wastewater treatment system, evaluating for the first time the effect of hydraulic regimes on nutritio…
Cultural Vocal Bursts Intensity Prediction