Distributionally Robust Power Policies for Wireless Systems under Power Fluctuation Risk
Modern wireless communication systems necessitate the development of cost-effective resource allocation strategies, while ensuring maximal system performance. While commonly realizable via efficient waterfilling schemes, ergodic-optimal policies often exhibit instantaneous resource constraint fluctuations as a result of fading variability, violating prescribed specifications possibly within unacceptable margins, inducing further operational challenges and/or costs. On the other extent, short-term-optimal policies -- commonly based on deterministic waterfilling-- while strictly maintaining operational specifications, are not only impractical and computationally demanding, but also suboptimal in a long-term sense. To address these challenges, we introduce a novel distributionally robust version of a classical point-to-point interference-free multi-terminal constrained stochastic resource allocation problem, by leveraging the Conditional Value-at-Risk (CVaR) as a coherent measure of power policy fluctuation risk. We derive closed-form dual-parameterized expressions for the CVaR-optimal resource policy, along with corresponding optimal CVaR quantile levels by capitalizing on (sampling) the underlying fading distribution. We subsequently develop two dual-domain schemes -- one model-based and one model-free -- to iteratively determine a globally-optimal resource policy. Our numerical simulations confirm the remarkable effectiveness of the proposed approach, also revealing an almost-constant character of the CVaR-optimal policy and at rather minimal ergodic rate optimality loss.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Stochastic and Distributionally Robust Load Ensemble Control
Demand response (DR) programs aim to engage distributed demand-side resources in providing ancillary services for electric power systems. Previously, aggregated thermostatically controlled loads (TCLs) have been demonstr…
Transmit power policies for stochastic stabilisation of multi-link wireless networked control systems
Transmit power control is one of the most important issues in wireless networks, where nodes typically operate on limited battery power. Reducing communicating power consumption is essential for both economic and ecologi…
Transmission power policies for energy-efficient wireless control of nonlinear system
We present a controller and transmission policy design procedure for nonlinear wireless networked control systems. Our objective is to ensure the stability of the closed-loop system, in a stochastic sense, together with …
Distributionally Robust Control Synthesis for Stochastic Systems with Safety and Reach-Avoid Specifications
We investigate the problem of synthesizing distributionally robust control policies for stochastic systems under safety and reach-avoid specifications. Using a game-theoretical framework, we consider the setting where th…
Optimal Resource Allocation in Wireless Control Systems via Deep Policy Gradient
In wireless control systems, remote control of plants is achieved through closing of the control loop over a wireless channel. As wireless communication is noisy and subject to packet dropouts, proper allocation of limit…
Deep Reinforcement LearningPolicy Gradient Methods