Deep Learning for Wireless Coded Caching with Unknown and Time-Variant Content Popularity

2020-08-21 · Zhe Zhang, Meixia Tao

Coded caching is effective in leveraging the accumulated storage size in wireless networks by distributing different coded segments of each file in multiple cache nodes. This paper aims to find a wireless coded caching policy to minimize the total discounted network cost, which involves both transmission delay and cache replacement cost, using tools from deep learning. The problem is known to be challenging due to the unknown, time-variant content popularity as well as the continuous, high-dimensional action space. We first propose a clustering based long short-term memory (C-LTSM) approach to predict the number of content requests using historical request information. This approach exploits the correlation of the historical request information between different files through clustering. Based on the predicted results, we then propose a supervised deep deterministic policy gradient (SDDPG) approach. This approach, on one hand, can learn the caching policy in continuous action space by using the actor-critic architecture. On the other hand, it accelerates the learning process by pre-training the actor network based on the solution of an approximate problem that minimizes the per-slot cost. Real-world trace-based numerical results show that the proposed prediction and caching policy using deep learning outperform the considered existing methods.

📄 PDF Abstract BibTeX arXiv:2008.09422

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Beamforming in Wireless Coded-Caching Systems

2023-09-11 · Sneha Madhusudan, Charitha Madapatha, Behrooz Makki, Hao Guo 외

Increased capacity in the access network poses capacity challenges on the transport network due to the aggregated traffic. However, there are spatial and time correlation in the user data demands that could potentially b…

Reinforcement Learning Based Cooperative Coded Caching under Dynamic Popularities in Ultra-Dense Networks

2020-03-08 · Shen Gao, Peihao Dong, Zhiwen Pan, Geoffrey Ye Li

For ultra-dense networks with wireless backhaul, caching strategy at small base stations (SBSs), usually with limited storage, is critical to meet massive high data rate requests. Since the content popularity profile var…

Q-Learning Reinforcement Learning Reinforcement Learning (RL)

Rate Splitting with Wireless Edge Caching: A System-Level-based Co-design

2021-10-24 · Eleni Demarchou, Constantinos Psomas, Ioannis Krikidis

Rate splitting (RS) and wireless edge caching are essential means for meeting the quality of service requirements of future wireless networks. In this work, we focus on the cross-layer co-design of wireless edge caching …

Deep Multi-Agent Reinforcement Learning Based Cooperative Edge Caching in Wireless Networks

2019-05-13 · Chen Zhong, M. Cenk Gursoy, Senem Velipasalar

The growing demand on high-quality and low-latency multimedia services has led to much interest in edge caching techniques. Motivated by this, we in this paper consider edge caching at the base stations with unknown cont…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Whittle Index based Q-Learning for Wireless Edge Caching with Linear Function Approximation

2022-02-26 · Guojun Xiong, Shufan Wang, Jian Li, Rahul Singh

We consider the problem of content caching at the wireless edge to serve a set of end users via unreliable wireless channels so as to minimize the average latency experienced by end users due to the constrained wireless …

Edge-computing Q-Learning Reinforcement Learning (RL)