paper-with-me

Papers

Meta Hierarchical Reinforcement Learning for Scalable Resource Management in O-RAN

2025-12-08 · Fatemeh Lotfi, Fatemeh Afghah arxiv

The increasing complexity of modern applications demands wireless networks capable of real time adaptability and efficient resource management. The Open Radio Access Network (O-RAN) architecture, with its RAN Intelligent Controller (RIC) modules, has emerged as a pivotal solution for dynamic resource management and network slicing. While artificial intelligence (AI) driven methods have shown promise, most approaches struggle to maintain performance under unpredictable and highly dynamic conditions. This paper proposes an adaptive Meta Hierarchical Reinforcement Learning (Meta-HRL) framework, inspired by Model Agnostic Meta Learning (MAML), to jointly optimize resource allocation and network slicing in O-RAN. The framework integrates hierarchical control with meta learning to enable both global and local adaptation: the high-level controller allocates resources across slices, while low level agents perform intra slice scheduling. The adaptive meta-update mechanism weights tasks by temporal difference error variance, improving stability and prioritizing complex network scenarios. Theoretical analysis establishes sublinear convergence and regret guarantees for the two-level learning process. Simulation results demonstrate a 19.8% improvement in network management efficiency compared with baseline RL and meta-RL approaches, along with faster adaptation and higher QoS satisfaction across eMBB, URLLC, and mMTC slices. Additional ablation and scalability studies confirm the method's robustness, achieving up to 40% faster adaptation and consistent fairness, latency, and throughput performance as network scale increases.

📄 PDF Abstract BibTeX arXiv:2512.13715

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning

Similar Papers 제목 키워드 기반

Deep Reinforcement Learning for Job Scheduling and Resource Management in Cloud Computing: An Algorithm-Level Review

2025-01-02 · Yan Gu, Zhaoze Liu, Shuhong Dai, Cong Liu 외

Cloud computing has revolutionized the provisioning of computing resources, offering scalable, flexible, and on-demand services to meet the diverse requirements of modern applications. At the heart of efficient cloud ope…

Cloud ComputingDeep Reinforcement LearningManagementScheduling

A Hierarchical Framework of Cloud Resource Allocation and Power Management Using Deep Reinforcement Learning

2017-03-13 · Ning Liu, Zhe Li, Zhiyuan Xu, Jielong Xu 외

Automatic decision-making approaches, such as reinforcement learning (RL), have been applied to (partially) solve the resource allocation problem adaptively in the cloud computing system. However, a complete cloud resour…

Cloud ComputingDecision MakingDeep Reinforcement LearningManagement+3

Meta Reinforcement Learning Approach for Adaptive Resource Optimization in O-RAN

2024-09-30 · Fatemeh Lotfi, Fatemeh Afghah

As wireless networks grow to support more complex applications, the Open Radio Access Network (O-RAN) architecture, with its smart RAN Intelligent Controller (RIC) modules, becomes a crucial solution for real-time networ…

Decision MakingDeep Reinforcement LearningManagementMeta-Learning+1

LLM-Integrated Digital Twins for Hierarchical Resource Allocation in 6G Networks

2025-06-23 · Majumder Haider, Imtiaz Ahmed, Zoheb Hassan, Kamrul Hasan 외

Next-generation (NextG) wireless networks are expected to require intelligent, scalable, and context-aware radio resource management (RRM) to support ultra-dense deployments, diverse service requirements, and dynamic net…

Decision MakingManagement

Meta-Reinforcement Learning with Discrete World Models for Adaptive Load Balancing

2025-03-11 · Cameron Redovian

We integrate a meta-reinforcement learning algorithm with the DreamerV3 architecture to improve load balancing in operating systems. This approach enables rapid adaptation to dynamic workloads with minimal retraining, ou…

ManagementMeta Reinforcement Learningreinforcement-learningReinforcement Learning