Combined Peak Reduction and Self-Consumption Using Proximal Policy Optimization
Residential demand response programs aim to activate demand flexibility at the household level. In recent years, reinforcement learning (RL) has gained significant attention for these type of applications. A major challenge of RL algorithms is data efficiency. New RL algorithms, such as proximal policy optimisation (PPO), have tried to increase data efficiency. Additionally, combining RL with transfer learning has been proposed in an effort to mitigate this challenge. In this work, we further improve upon state-of-the-art transfer learning performance by incorporating demand response domain knowledge into the learning pipeline. We evaluate our approach on a demand response use case where peak shaving and self-consumption is incentivised by means of a capacity tariff. We show our adapted version of PPO, combined with transfer learning, reduces cost by 14.51% compared to a regular hysteresis controller and by 6.68% compared to traditional PPO.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement Learning (RL)Transfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PReS: Power Peak Reduction by Real-time Scheduling for Urban Railway Transit
Railway transportation is one of the most popular options for Urban Massive Transportation Systems (UMTS) because of many attractive features. A robust electric power supply is essential to enable normal operation. Howev…
SchedulingSelf-supervised Speaker Recognition Training Using Human-Machine Dialogues
Speaker recognition, recognizing speaker identities based on voice alone, enables important downstream applications, such as personalization and authentication. Learning speaker representations, in the context of supervi…
Contrastive LearningSpeaker RecognitionSelf-attention encoding and pooling for speaker recognition
The computing power of mobile devices limits the end-user applications in terms of storage size, processing, memory and energy consumption. These limitations motivate researchers for the design of more efficient deep mod…
Speaker RecognitionSpeaker VerificationText-Independent Speaker VerificationRisk-aware Scheduling and Dispatch of Flexibility Events in Buildings
Residential and commercial buildings, equipped with systems such as heat pumps (HPs), hot water tanks, or stationary energy storage, have a large potential to offer their consumption flexibility as grid services. In this…
SchedulingLearning to Unscramble Feynman Loop Integrals with SAILIR
Integration-by-parts (IBP) reduction of Feynman integrals to master integrals is a key computational bottleneck in precision calculations in high-energy physics. Traditional approaches based on the Laporta algorithm requ…