paper-with-me

Papers

Intelligent Task Scheduling for Microservices via A3C-Based Reinforcement Learning

2025-05-01 · Yang Wang, Tengda Tang, Zhou Fang, Yingnan Deng, Yifei Duan

To address the challenges of high resource dynamism and intensive task concurrency in microservice systems, this paper proposes an adaptive resource scheduling method based on the A3C reinforcement learning algorithm. The scheduling problem is modeled as a Markov Decision Process, where policy and value networks are jointly optimized to enable fine-grained resource allocation under varying load conditions. The method incorporates an asynchronous multi-threaded learning mechanism, allowing multiple agents to perform parallel sampling and synchronize updates to the global network parameters. This design improves both policy convergence efficiency and model stability. In the experimental section, a real-world dataset is used to construct a scheduling scenario. The proposed method is compared with several typical approaches across multiple evaluation metrics, including task delay, scheduling success rate, resource utilization, and convergence speed. The results show that the proposed method delivers high scheduling performance and system stability in multi-task concurrent environments. It effectively alleviates the resource allocation bottlenecks faced by traditional methods under heavy load, demonstrating its practical value for intelligent scheduling in microservice systems.

📄 PDF Abstract BibTeX arXiv:2505.00299

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learningReinforcement LearningScheduling

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Entropy Regularization 설명 없음
A3C A3C, Asynchronous Advantage Actor Critic, is a policy gradient algorithm in reinforcement learning that maintains a policy $\pi\left(a\_{t}\mid{s}\_{t}; \theta\right)$ and…

Similar Papers 제목 키워드 기반

Minerva: A Portable Machine Learning Microservice Framework for Traditional Enterprise SaaS Applications

2020-05-02 · Venkata Duvvuri

In traditional SaaS enterprise applications, microservices are an essential ingredient to deploy machine learning (ML) models successfully. In general, microservices result in efficiencies in software service design, dev…

BIG-bench Machine Learning

Deep Q-Learning-Based Intelligent Scheduling for ETL Optimization in Heterogeneous Data Environments

2025-12-15 · Kangning Gao, Yi Hu, Cong Nie, Wei Li arxiv

This paper addresses the challenges of low scheduling efficiency, unbalanced resource allocation, and poor adaptability in ETL (Extract-Transform-Load) processes under heterogeneous data environments by proposing an inte…

Reinforcement Learning

Reinforcement Learning for Adaptive Resource Scheduling in Complex System Environments

2024-11-08 · Pochun Li, Yuyang Xiao, Jinghua Yan, Xuan Li 외

This study presents a novel computer system performance optimization and adaptive workload management scheduling algorithm based on Q-learning. In modern computing environments, characterized by increasing data volumes, …

Cloud ComputingEdge-computingQ-Learningreinforcement-learning+2

Reclaimer: A Reinforcement Learning Approach to Dynamic Resource Allocation for Cloud Microservices

2023-04-17 · Quintin Fettes, Avinash Karanth, Razvan Bunescu, Brandon Beckwith 외

Many cloud applications are migrated from the monolithic model to a microservices framework in which hundreds of loosely-coupled microservices run concurrently, with significant benefits in terms of scalability, rapid de…

CPUDeep Reinforcement Learningreinforcement-learning

Reinforcement Learning based Condition-oriented Maintenance Scheduling for Flow Line Systems

2021-08-27 · Raphael Lamprecht, Ferdinand Wurst, Marco F. Huber

Maintenance scheduling is a complex decision-making problem in the production domain, where a number of maintenance tasks and resources has to be assigned and scheduled to production entities in order to prevent unplanne…

Decision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+2