paper-with-me

Papers

Enhanced Pub/Sub Communications for Massive IoT Traffic with SARSA Reinforcement Learning

2021-01-03 · Carlos E. Arruda, Pedro F. Moraes, Nazim Agoulmine, Joberto S. B. Martins

Sensors are being extensively deployed and are expected to expand at significant rates in the coming years. They typically generate a large volume of data on the internet of things (IoT) application areas like smart cities, intelligent traffic systems, smart grid, and e-health. Cloud, edge and fog computing are potential and competitive strategies for collecting, processing, and distributing IoT data. However, cloud, edge, and fog-based solutions need to tackle the distribution of a high volume of IoT data efficiently through constrained and limited resource network infrastructures. This paper addresses the issue of conveying a massive volume of IoT data through a network with limited communications resources (bandwidth) using a cognitive communications resource allocation based on Reinforcement Learning (RL) with SARSA algorithm. The proposed network infrastructure (PSIoTRL) uses a Publish/ Subscribe architecture to access massive and highly distributed IoT data. It is demonstrated that the PSIoTRL bandwidth allocation for buffer flushing based on SARSA enhances the IoT aggregator buffer occupation and network link utilization. The PSIoTRL dynamically adapts the IoT aggregator traffic flushing according to the Pub/Sub topic's priority and network constraint requirements.

📄 PDF Abstract BibTeX arXiv:2101.00687

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Sarsa Sarsa is an on-policy TD control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} + \gamma{Q}\left(S\_{t+1},…

Similar Papers 제목 키워드 기반

GAN-Enhanced Deep Reinforcement Learning for Semantic-Aware Resource Allocation in 6G Network Slicing

2026-03-27 · Daniel Benniah John arxiv

Sixth-generation (6G) wireless networks must support heterogeneous services: enhanced Mobile Broadband (eMBB) requiring 1 Tbps data rates, massive Machine-Type Communications (mMTC) supporting 10 million devices per km, …

Reinforcement Learning

Adversarial Attacks in AI-Driven RAN Slicing: SLA Violations and Recovery

2026-04-01 · Deemah H. Tashman, Soumaya Cherkaoui arxiv

Next-generation (NextG) cellular networks are designed to support emerging applications with diverse data rate and latency requirements, such as immersive multimedia services and large-scale Internet of Things deployment…

Reinforcement Learning

Study on MCS Selection and Spectrum Allocation for URLLC Traffic under Delay and Reliability Constraint in 5G Network

2021-01-06 · Yuehong Gao, Changhao Sun, Xiaonan Zhang, Xiao Hong

To support Ultra-Reliable and Low Latency Communications (URLLC) is an essential character of the 5th Generation (5G) communication system. Unlike the other two use cases defined in 5G, e.g. enhanced Mobile Broadband (eM…

Autonomous Reinforcement of Behavioral Sequences in Neural Dynamics

2012-10-12 · Sohrob Kazerounian, Matthew Luciw, Mathis Richter, Yulia Sandamirskaya

We introduce a dynamic neural algorithm called Dynamic Neural (DN) SARSA(\lambda) for learning a behavioral sequence from delayed reward. DN-SARSA(\lambda) combines Dynamic Field Theory models of behavioral sequence repr…

General Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Optimization of Grant-Free NOMA with Multiple Configured-Grants for mURLLC

2021-11-17 · Yan Liu, Yansha Deng, Maged Elkashlan, Arumugam Nallanathan 외

Massive Ultra-Reliable and Low-Latency Communications (mURLLC), which integrates URLLC with massive access, is emerging as a new and important service class in the next generation (6G) for time-sensitive traffics and has…