paper-with-me

홈 › Papers

Cellular traffic offloading via Opportunistic Networking with Reinforcement Learning

2021-10-01 · Lorenzo Valerio, Raffaele Bruno, Andrea Passarella

The widespread diffusion of mobile phones is triggering an exponential growth of mobile data traffic that is likely to cause, in the near future, considerable traffic overload issues even in last-generation cellular networks. Offloading part of the traffic to other networks is considered a very promising approach and, in particular, in this paper, we consider offloading through opportunistic networks of users' devices. However, the performance of this solution strongly depends on the pattern of encounters between mobile nodes, which should therefore be taken into account when designing offloading control algorithms. In this paper, we propose an adaptive offloading solution based on the Reinforcement Learning framework and we evaluate and compare the performance of two well-known learning algorithms: Actor-Critic and Q-Learning. More precisely, in our solution the controller of the dissemination process, once trained, is able to select a proper number of content replicas to be injected into the opportunistic network to guarantee the timely delivery of contents to all interested users. We show that our system based on Reinforcement Learning is able to automatically learn a very efficient strategy to reduce the traffic on the cellular network, without relying on any additional context information about the opportunistic network. Our solution achieves a higher level of offloading with respect to other state-of-the-art approaches, in a range of different mobility settings. Moreover, we show that a more refined learning solution, based on the Actor-Critic algorithm, is significantly more efficient than a simpler solution based on Q-learning.

📄 PDF Abstract BibTeX arXiv:2110.00397

Code (0)

등록된 구현이 없습니다.

Tasks

Q-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Applications of Deep Reinforcement Learning in Communications and Networking: A Survey

2018-10-18 · Nguyen Cong Luong, Dinh Thai Hoang, Shimin Gong, Dusit Niyato 외

This paper presents a comprehensive literature review on applications of deep reinforcement learning in communications and networking. Modern networks, e.g., Internet of Things (IoT) and Unmanned Aerial Vehicle (UAV) net…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Multi-Agent Reinforcement Learning for Offloading Cellular Communications with Cooperating UAVs

2024-02-05 · Abhishek Mondal, Deepak Mishra, Ganesh Prasad, George C. Alexandropoulos 외

Effective solutions for intelligent data collection in terrestrial cellular networks are crucial, especially in the context of Internet of Things applications. The limited spectrum and coverage area of terrestrial base s…

Decision MakingMulti-agent Reinforcement LearningQ-Learningreinforcement-learning+1

Reinforcement Learning for Opportunistic Routing in Software-Defined LEO-Terrestrial Systems

2026-01-20 · Sivaram Krishnan, Zhouyou Gu, Jihong Park, Sung-Min Oh 외 arxiv

The proliferation of large-scale low Earth orbit (LEO) satellite constellations is driving the need for intelligent routing strategies that can effectively deliver data to terrestrial networks under rapidly time-varying …

Stochastic OptimizationReinforcement Learning

Differentiated Federated Reinforcement Learning Based Traffic Offloading on Space-Air-Ground Integrated Networks

2022-12-05 · Yeguang Qin, Yilin Yang, Fengxiao Tang, Xin Yao 외

The Space-Air-Ground Integrated Network (SAGIN) plays a pivotal role as a comprehensive foundational network communication infrastructure, presenting opportunities for highly efficient global data transmission. Nonethele…

FairnessFederated Learningreinforcement-learningReinforcement Learning+1

Content-Level Selective Offloading in Heterogeneous Networks: Multi-armed Bandit Optimization and Regret Bounds

2014-07-23 · Pol Blasco, Deniz Gündüz

We consider content-level selective offloading of cellular downlink traffic to a wireless infostation terminal which stores high data-rate content in its cache memory. Cellular users in the vicinity of the infostation ca…