Reinforcement Learning for Caching with Space-Time Popularity Dynamics

2020-05-19 · Alireza Sadeghi, Georgios B. Giannakis, Gang Wang, Fatemeh Sheikholeslami

With the tremendous growth of data traffic over wired and wireless networks along with the increasing number of rich-media applications, caching is envisioned to play a critical role in next-generation networks. To intelligently prefetch and store contents, a cache node should be able to learn what and when to cache. Considering the geographical and temporal content popularity dynamics, the limited available storage at cache nodes, as well as the interactive in uence of caching decisions in networked caching settings, developing effective caching policies is practically challenging. In response to these challenges, this chapter presents a versatile reinforcement learning based approach for near-optimal caching policy design, in both single-node and network caching settings under dynamic space-time popularities. The herein presented policies are complemented using a set of numerical tests, which showcase the merits of the presented approach relative to several standard caching policies.

📄 PDF Abstract BibTeX arXiv:2005.09155

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Reinforcement Learning Based Cooperative Coded Caching under Dynamic Popularities in Ultra-Dense Networks

2020-03-08 · Shen Gao, Peihao Dong, Zhiwen Pan, Geoffrey Ye Li

For ultra-dense networks with wireless backhaul, caching strategy at small base stations (SBSs), usually with limited storage, is critical to meet massive high data rate requests. Since the content popularity profile var…

Q-Learning Reinforcement Learning Reinforcement Learning (RL)

Cocktail Edge Caching: Ride Dynamic Trends of Content Popularity with Ensemble Learning

2021-01-14 · Tongyu Zong, Chen Li, Yuanyuan Lei, Guangyu Li 외

Edge caching will play a critical role in facilitating the emerging content-rich applications. However, it faces many new challenges, in particular, the highly dynamic content popularity and the heterogeneous caching con…

Deep Reinforcement Learning Ensemble Learning Time Series Time Series Analysis

Distributed Reinforcement Learning for Privacy-Preserving Dynamic Edge Caching

2021-10-20 · Shengheng Liu, Chong Zheng, Yongming Huang, Tony Q. S. Quek

Mobile edge computing (MEC) is a prominent computing paradigm which expands the application fields of wireless communication. Due to the limitation of the capacities of user equipments and MEC servers, edge caching (EC) …

Edge-computing Federated Learning Privacy Preserving reinforcement-learning+2

Edge Caching Optimization with PPO and Transfer Learning for Dynamic Environments

2024-11-14 · Farnaz Niknia, Ping Wang

This paper addresses the challenge of edge caching in dynamic environments, where rising traffic loads strain backhaul links and core networks. We propose a Proximal Policy Optimization (PPO)-based caching strategy that …

Deep Reinforcement Learning Transfer Learning

Multi-Time Scale Service Caching and Pricing in MEC Systems with Dynamic Program Popularity

2024-07-04 · Yiming Chen, Xingyuan Hu, Bo Gu, Shimin Gong 외

In mobile edge computing systems, base stations (BSs) equipped with edge servers can provide computing services to users to reduce their task execution time. However, there is always a conflict of interest between the BS…

Deep Reinforcement Learning Edge-computing