paper-with-me

Papers

Deep Learning Based Simulators for the Phosphorus Removal Process Control in Wastewater Treatment via Deep Reinforcement Learning Algorithms

2024-01-23 · Esmaeel Mohammadi, Mikkel Stokholm-Bjerregaard, Aviaja Anna Hansen, Per Halkjær Nielsen, Daniel Ortiz-Arroyo, Petar Durdevic

Phosphorus removal is vital in wastewater treatment to reduce reliance on limited resources. Deep reinforcement learning (DRL) is a machine learning technique that can optimize complex and nonlinear systems, including the processes in wastewater treatment plants, by learning control policies through trial and error. However, applying DRL to chemical and biological processes is challenging due to the need for accurate simulators. This study trained six models to identify the phosphorus removal process and used them to create a simulator for the DRL environment. Although the models achieved high accuracy (>97%), uncertainty and incorrect prediction behavior limited their performance as simulators over longer horizons. Compounding errors in the models' predictions were identified as one of the causes of this problem. This approach for improving process control involves creating simulation environments for DRL algorithms, using data from supervisory control and data acquisition (SCADA) systems with a sufficient historical horizon without complex system modeling or parameter estimation.

📄 PDF Abstract BibTeX arXiv:2401.12822

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningparameter estimation

Similar Papers 제목 키워드 기반

Application of Soft Actor-Critic Algorithms in Optimizing Wastewater Treatment with Time Delays Integration

2024-11-27 · Esmaeel Mohammadi, Daniel Ortiz-Arroyo, Aviaja Anna Hansen, Mikkel Stokholm-Bjerregaard 외

Wastewater treatment plants face unique challenges for process control due to their complex dynamics, slow time constants, and stochastic delays in observations and actions. These characteristics make conventional contro…

Deep Reinforcement Learningreinforcement-learningReinforcement Learning

Wastewater Treatment Plant Data for Nutrient Removal System

2024-07-07 · Esmaeel Mohammadi, Anju Rani, Mikkel Stokholm-Bjerregaard, Daniel Ortiz-Arroyo 외

This paper introduces the Agtrup (BlueKolding) dataset, collected from Denmark's Agtrup wastewater treatment plant, specifically designed to enhance phosphorus removal via chemical and biological methods. This rich datas…

Deep Reinforcement LearningManagement

Constructed wetlands operated as bioelectrochemical systems for the removal of organic micropollutants

2021-01-14 · M. Hartl, M. J. García-Galán, V. Matamoros, M. Fernández-Gatell 외

The removal of organic micropollutants (OMPs) has been investigated in constructed wetlands (CWs) operated as bioelectrochemical systems (BES). The operation of CWs as BES (CW-BES), either in the form of microbial fuel c…

Improved Long Short-Term Memory-based Wastewater Treatment Simulators for Deep Reinforcement Learning

2024-03-22 · Esmaeel Mohammadi, Daniel Ortiz-Arroyo, Mikkel Stokholm-Bjerregaard, Aviaja Anna Hansen 외

Even though Deep Reinforcement Learning (DRL) showed outstanding results in the fields of Robotics and Games, it is still challenging to implement it in the optimization of industrial processes like wastewater treatment.…

Deep Reinforcement LearningDynamic Time Warping

Selection of cyanobacteria over green algae in a photo-sequencing batch bioreactor fed with wastewater

2018-12-22

A strategy based on photo sequencing batch operation was used to select cyanobacteria over unsettled green algae in a wastewater treatment system, evaluating for the first time the effect of hydraulic regimes on nutritio…

Cultural Vocal Bursts Intensity Prediction