An application of reinforcement learning to residential energy storage under real-time pricing
With the proliferation of advanced metering infrastructure (AMI), more real-time data is available to electric utilities and consumers. Such high volumes of data facilitate innovative electricity rate structures beyond flat-rate and time-of-use (TOU) tariffs. One such innovation is real-time pricing (RTP), in which the wholesale market-clearing price is passed directly to the consumer on an hour-by-hour basis. While rare, RTP exists in parts of the United States and has been observed to reduce electric bills. Although these reductions are largely incidental, RTP may represent an opportunity for large-scale peak shaving, demand response, and economic efficiency when paired with intelligent control systems. Algorithms controlling flexible loads and energy storage have been deployed for demand response elsewhere in the literature, but few studies have investigated these algorithms in an RTP environment. If properly optimized, the dynamic between RTP and intelligent control has the potential to counteract the unwelcome spikes and dips of demand driven by growing penetration of distributed renewable generation and electric vehicles (EV). This paper presents a simple reinforcement learning (RL) application for optimal battery control subject to an RTP signal.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Explainable AI: Deep Reinforcement Learning Agents for Residential Demand Side Cost Savings in Smart Grids
Motivated by recent advancements in Deep Reinforcement Learning (RL), we have developed an RL agent to manage the operation of storage devices in a household and is designed to maximize demand-side cost savings. The prop…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Impact of spatiotemporal heterogeneity in heat pump loads on generation and storage requirements
This paper investigates how spatiotemporal heterogeneity in inflexible residential heat pump loads affects the need for storage and generation in the electricity system under business-as-usual and low-carbon emissions bu…
Deeply decarbonizing residential and urban central districts through photovoltaics plus electric vehicle applications
With the costs of renewable energy technologies declining, new forms of urban energy systems are emerging that can be established in a cost-effective way. The SolarEV City concept has been proposed that uses rooftop Phot…
Promoting Shared Energy Storage Aggregation among High Price-Tolerance Prosumer: An Incentive Deposit and Withdrawal Service
Many residential prosumers exhibit a high price-tolerance for household electricity bills and a low response to price incentives. This is because the household electricity bills are not inherently high, and the potential…
Deep Reinforcement LearningA Sufficient Condition to Guarantee Non-Simultaneous Charging and Discharging of Household Battery Energy Storage
In this letter, we model the day-ahead price-based demand response of a residential household with battery energy storage and other controllable loads, as a convex optimization problem. Further using duality theory and K…