Deep Reinforcement Learning for Scheduling in Cellular Networks

2019-05-15 · Jian Wang, Chen Xu, Yourui Huangfu, Rong Li, Yiqun Ge, Jun Wang

Integrating artificial intelligence (AI) into wireless networks has drawn significant interest in both industry and academia. A common solution is to replace partial or even all modules in the conventional systems, which is often lack of efficiency and robustness due to their ignoring of expert knowledge. In this paper, we take deep reinforcement learning (DRL) based scheduling as an example to investigate how expert knowledge can help with AI module in cellular networks. A simulation platform, which has considered link adaption, feedback and other practical mechanisms, is developed to facilitate the investigation. Besides the traditional way, which is learning directly from the environment, for training DRL agent, we propose two novel methods, i.e., learning from a dual AI module and learning from the expert solution. The results show that, for the considering scheduling problem, DRL training procedure can be improved on both performance and convergence speed by involving the expert knowledge. Hence, instead of replacing conventional scheduling module in the system, adding a newly introduced AI module, which is capable to interact with the conventional module and provide more flexibility, is a more feasible solution.

📄 PDF Abstract BibTeX arXiv:1905.05914

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Scheduling

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Scheduling Out-of-Coverage Vehicular Communications Using Reinforcement Learning

2022-07-13 · Taylan Şahin, Ramin Khalili, Mate Boban, Adam Wolisz

Performance of vehicle-to-vehicle (V2V) communications depends highly on the employed scheduling approach. While centralized network schedulers offer high V2V communication reliability, their operation is conventionally …

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Buffer-aware Wireless Scheduling based on Deep Reinforcement Learning

2019-11-13 · Chen Xu, Jian Wang, Tianhang Yu, Chuili Kong 외

In this paper, the downlink packet scheduling problem for cellular networks is modeled, which jointly optimizes throughput, fairness and packet drop rate. Two genie-aided heuristic search methods are employed to explore …

Deep Reinforcement Learning Fairness Heuristic Search reinforcement-learning+3

Deep-Reinforcement-Learning-Based Scheduling with Contiguous Resource Allocation for Next-Generation Cellular Systems

2020-10-11 · Shu Sun, Xiaofeng Li

Scheduling plays a pivotal role in multi-user wireless communications, since the quality of service of various users largely depends upon the allocated radio resources. In this paper, we propose a novel scheduling algori…

Deep Reinforcement Learning Reinforcement Learning (RL)Scheduling

Smart Scheduling based on Deep Reinforcement Learning for Cellular Networks

2021-03-22 · Jian Wang, Chen Xu, Rong Li, Yiqun Ge 외

To improve the system performance towards the Shannon limit, advanced radio resource management mechanisms play a fundamental role. In particular, scheduling should receive much attention, because it allocates radio reso…

Deep Reinforcement Learning Fairness Management reinforcement-learning+3

QoS-Aware Scheduling in New Radio Using Deep Reinforcement Learning

2021-07-14 · Jakob Stigenberg, Vidit Saxena, Soma Tayamon, Euhanna Ghadimi

Fifth-generation (5G) New Radio (NR) cellular networks support a wide range of new services, many of which require an application-specific quality of service (QoS), e.g. in terms of a guaranteed minimum bit-rate or a max…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1