A Constrained RL Approach for Cost-Efficient Delivery of Latency-Sensitive Applications
Next-generation networks aim to provide performance guarantees to real-time interactive services that require timely and cost-efficient packet delivery. In this context, the goal is to reliably deliver packets with strict deadlines imposed by the application while minimizing overall resource allocation cost. A large body of work has leveraged stochastic optimization techniques to design efficient dynamic routing and scheduling solutions under average delay constraints; however, these methods fall short when faced with strict per-packet delay requirements. We formulate the minimum-cost delay-constrained network control problem as a constrained Markov decision process and utilize constrained deep reinforcement learning (CDRL) techniques to effectively minimize total resource allocation cost while maintaining timely throughput above a target reliability level. Results indicate that the proposed CDRL-based solution can ensure timely packet delivery even when existing baselines fall short, and it achieves lower cost compared to other throughput-maximizing methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Stochastic OptimizationReinforcement LearningSimilar Papers 제목 키워드 기반
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey
On-device large language models (LLMs), referring to running LLMs on edge devices, have raised considerable interest since they are more cost-effective, latency-efficient, and privacy-preserving compared with the cloud p…
Cloud ComputingEdge-computingPrivacy PreservingSurveyA Flexible Multi-Agent Deep Reinforcement Learning Framework for Dynamic Routing and Scheduling of Latency-Critical Services
Timely delivery of delay-sensitive information over dynamic, heterogeneous networks is increasingly essential for a range of interactive applications, such as industrial automation, self-driving vehicles, and augmented r…
Stochastic OptimizationReinforcement LearningCache-Enabled Coordinated Mobile Edge Network: Opportunities and Challenges
Cache-enabled coordinated mobile edge network is an emerging network architecture, wherein serving nodes located at the network edge have the capabilities of baseband signal processing and caching files at their local ca…
A Hybrid TDMA/CSMA Protocol for Time-Sensitive Traffic in Robot Applications
Recent progress in robotics has underscored the demand for real-time control in applications such as manufacturing, healthcare, and autonomous systems, where the timely delivery of mission-critical commands under heterog…
Caching Techniques for Reducing the Communication Cost of Federated Learning in IoT Environments
Federated Learning (FL) allows multiple distributed devices to jointly train a shared model without centralizing data, but communication cost remains a major bottleneck, especially in resource-constrained environments. T…
Federated Learning