Anomaly Detection for Scalable Task Grouping in Reinforcement Learning-based RAN Optimization

2023-12-06 · Jimmy Li, Igor Kozlov, Di wu, Xue Liu, Gregory Dudek

The use of learning-based methods for optimizing cellular radio access networks (RAN) has received increasing attention in recent years. This coincides with a rapid increase in the number of cell sites worldwide, driven largely by dramatic growth in cellular network traffic. Training and maintaining learned models that work well across a large number of cell sites has thus become a pertinent problem. This paper proposes a scalable framework for constructing a reinforcement learning policy bank that can perform RAN optimization across a large number of cell sites with varying traffic patterns. Central to our framework is a novel application of anomaly detection techniques to assess the compatibility between sites (tasks) and the policy bank. This allows our framework to intelligently identify when a policy can be reused for a task, and when a new policy needs to be trained and added to the policy bank. Our results show that our approach to compatibility assessment leads to an efficient use of computational resources, by allowing us to construct a performant policy bank without exhaustively training on all tasks, which makes it applicable under real-world constraints.

📄 PDF Abstract BibTeX arXiv:2312.03277

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection

ClusterLog: Clustering Logs for Effective Log-based Anomaly Detection

2023-01-19 · Chris Egersdoerfer, Dong Dai, Di Zhang

With the increasing prevalence of scalable file systems in the context of High Performance Computing (HPC), the importance of accurate anomaly detection on runtime logs is increasing. But as it currently stands, many sta…

Anomaly Detection Clustering Semantic Similarity Semantic Textual Similarity

DRTA: Dynamic Reward Scaling for Reinforcement Learning in Time Series Anomaly Detection

2025-08-25 · Bahareh Golchin, Banafsheh Rekabdar, Kunpeng Liu arxiv

Anomaly detection in time series data is important for applications in finance, healthcare, sensor networks, and industrial monitoring. Traditional methods usually struggle with limited labeled data, high false-positive …

Time Series Anomaly Detection Reinforcement Learning Active Learning

LLM-Enhanced Reinforcement Learning for Time Series Anomaly Detection

2026-01-05 · Bahareh Golchin, Banafsheh Rekabdar, Danielle Justo arxiv

Detecting anomalies in time series data is crucial for finance, healthcare, sensor networks, and industrial monitoring applications. However, time series anomaly detection often suffers from sparse labels, complex tempor…

Time Series Anomaly Detection Reinforcement Learning Active Learning

Hierarchical Reinforcement Learning for Optimal Agent Grouping in Cooperative Systems

2025-01-11 · Liyuan Hu

This paper presents a hierarchical reinforcement learning (RL) approach to address the agent grouping or pairing problem in cooperative multi-agent systems. The goal is to simultaneously learn the optimal grouping and ag…

Decision Making Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Swift Hydra: Self-Reinforcing Generative Framework for Anomaly Detection with Multiple Mamba Models

2025-03-09 · Nguyen Do, Truc Nguyen, Malik Hassanaly, Raed Alharbi 외

Despite a plethora of anomaly detection models developed over the years, their ability to generalize to unseen anomalies remains an issue, particularly in critical systems. This paper aims to address this challenge by in…

Anomaly Detection Mamba Mixture-of-Experts Reinforcement Learning (RL)