Reinforcement Learning -based Adaptation and Scheduling Methods for Multi-source DASH
Dynamic adaptive streaming over HTTP (DASH) has been widely used in video streaming recently. In DASH, the client downloads video chunks in order from a server. The rate adaptation function at the video client enhances the user's quality-of-experience (QoE) by choosing a suitable quality level for each video chunk to download based on the network condition. Today networks such as content delivery networks, edge caching networks, content-centric networks,... usually replicate video contents on multiple cache nodes. We study video streaming from multiple sources in this work. In multi-source streaming, video chunks may arrive out of order due to different conditions of the network paths. Hence, to guarantee a high QoE, the video client needs not only rate adaptation but also chunk scheduling. Reinforcement learning (RL) has emerged as the state-of-the-art control method in various fields in recent years. This paper proposes two algorithms for streaming from multiple sources: RL-based adaptation with greedy scheduling (RLAGS) and RL-based adaptation and scheduling (RLAS). We also build a simulation environment for training and evaluating. The efficiency of the proposed algorithms is proved via extensive simulations with real-trace data.
Code (1)
Tasks
reinforcement-learningReinforcement Learning (RL)SchedulingSimilar Papers 제목 키워드 기반
Safe Hierarchical Reinforcement Learning for CubeSat Task Scheduling Based on Energy Consumption
This paper presents a Hierarchical Reinforcement Learning methodology tailored for optimizing CubeSat task scheduling in Low Earth Orbits (LEO). Incorporating a high-level policy for global task distribution and a low-le…
Hierarchical Reinforcement Learningreinforcement-learningReinforcement LearningSchedulingAutonomous Resource Management in Microservice Systems via Reinforcement Learning
This paper proposes a reinforcement learning-based method for microservice resource scheduling and optimization, aiming to address issues such as uneven resource allocation, high latency, and insufficient throughput in t…
Managementreinforcement-learningReinforcement LearningSchedulingA Production Scheduling Framework for Reinforcement Learning Under Real-World Constraints
The classical Job Shop Scheduling Problem (JSSP) focuses on optimizing makespan under deterministic constraints. Real-world production environments introduce additional complexities that cause traditional scheduling appr…
Job Shop SchedulingReinforcement Learning (RL)SchedulingIntelligent Task Scheduling for Microservices via A3C-Based Reinforcement Learning
To address the challenges of high resource dynamism and intensive task concurrency in microservice systems, this paper proposes an adaptive resource scheduling method based on the A3C reinforcement learning algorithm. Th…
reinforcement-learningReinforcement LearningSchedulingOptimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach
Multi-uncertainties from power sources and loads have brought significant challenges to the stable demand supply of various resources at islands. To address these challenges, a comprehensive scheduling framework is propo…
Computational EfficiencyDecision MakingDeep Reinforcement Learningreinforcement-learning+3