Long-term planning, short-term adjustments
Deep Reinforcement Learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on real-world physical systems remains limited. Despite the advancements in RL algorithms, the industries often prefer traditional control strategies. Traditional methods are simple, computationally efficient and easy to adjust. In this paper, we propose a new Q-learning algorithm for continuous action space, which can bridge the control and RL algorithms and bring us the best of both worlds. Our method can learn complex policies to achieve long-term goals and at the same time it can be easily adjusted to address short-term requirements without retraining. We achieve this by modeling both short-term and long-term prediction models. The short-term prediction model represents the estimation of the system dynamic while the long-term prediction model represents the Q-value. The case studies demonstrate that our proposed method can achieve short-term and long-term goals without complex reward functions.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningPredictionQ-LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Distributed Eco-Driving Algorithm of Vehicle Platoon Using Traffic Light and Road Slope Information
This paper investigates the problem of ecological driving (eco-driving) of vehicle platoons. To reduce the probability of the platoon avoiding red lights and increase fuel efficiency, a two-layer control architecture is …
Deep Reinforcement Learning with Adjustments
Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their app…
Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning+1Capturing Chronology and Extreme Values of Representative Days for Planning of Transmission Lines and Long-Term Energy Storage Systems
The growing penetration of renewable energy sources (RESs) is inevitable to reach net zero emissions. In this regard, optimal planning and operation of power systems are becoming more critical due to the need for modelin…
Time SeriesS&P 500 Trend Prediction
This project aims to predict short-term and long-term upward trends in the S&P 500 index using machine learning models and feature engineering based on the "101 Formulaic Alphas" methodology. The study employed multiple …
Feature EngineeringFeature Importancefeature selectionMissing Values+1Two-stage Robust Energy Storage Planning with Probabilistic Guarantees: A Data-driven Approach
This paper addresses a central challenge of jointly considering shorter-term (e.g. hourly) and longer-term (e.g. yearly) uncertainties in power system planning with increasing penetration of renewable and storage resourc…
Decision Making