paper-with-me

Papers

A unified decision making framework for supply and demand management in microgrid networks

2017-11-14 · Diddigi Raghuram Bharadwaj, Sai Koti Reddy Danda, Krishnasuri Narayanam, Shalabh Bhatnagar

This paper considers two important problems -- on the supply-side and demand-side respectively and studies both in a unified framework. On the supply side, we study the problem of energy sharing among microgrids with the goal of maximizing profit obtained from selling power while at the same time not deviating much from the customer demand. On the other hand, under shortage of power, this problem becomes one of deciding the amount of power to be bought with dynamically varying prices. On the demand side, we consider the problem of optimally scheduling the time-adjustable demand - i.e., of loads with flexible time windows in which they can be scheduled. While previous works have treated these two problems in isolation, we combine these problems together and provide a unified Markov decision process (MDP) framework for these problems. We then apply the Q-learning algorithm, a popular model-free reinforcement learning technique, to obtain the optimal policy. Through simulations, we show that the policy obtained by solving our MDP model provides more profit to the microgrids.

📄 PDF Abstract BibTeX arXiv:1711.05078

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingManagementQ-LearningReinforcement LearningScheduling

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

A Unified Representation Framework for Rideshare Marketplace Equilibrium and Efficiency

2023-02-28 · Alex Chin, Zhiwei Qin

Ridesharing platforms are a type of two-sided marketplace where ``supply-demand balance'' is critical for market efficiency and yet is complex to define and analyze. We present a unified analytical framework based on the…

Matching of Everyday Power Supply and Demand with Dynamic Pricing: Problem Formalisation and Conceptual Analysis

2023-01-27 · Thibaut Théate, Antonio Sutera, Damien Ernst

The energy transition is expected to significantly increase the share of renewable energy sources whose production is intermittent in the electricity mix. Apart from key benefits, this development has the major drawback …

Decision Making

One-Shot Coordination of First and Last Mode Transportation

2020-01-05 · Subhajit Goswami, Pavankumar Tallapragada

In this paper, we consider coordinated control of feeder vehicles for first and last mode transportation. The model is macroscopic with volumes of demands and supplies along with flows of vehicles. We propose a one-shot …

Computational EfficiencyDisaster Response

OR-Transformer: Scaling Real-Time Decision-Making to 1,000 Items

2026-09-01 · Shuze Daniel Liu, David Simchi-Levi, Claire Chen, Chutong Gao 외 arxiv

Modern supply chain operations can require coordinating replenishment across thousands of heterogeneous items under correlated stochastic demand, heterogeneous lead times, and shared fixed ordering costs, yielding observ…

Reinforcement Learning

Managing Geological Uncertainty in Critical Mineral Supply Chains: A POMDP Approach with Application to U.S. Lithium Resources

2025-02-08 · Mansur Arief, Yasmine Alonso, CJ Oshiro, William Xu 외

The world is entering an unprecedented period of critical mineral demand, driven by the global transition to renewable energy technologies and electric vehicles. This transition presents unique challenges in mineral reso…

Decision Making