paper-with-me

홈 › Papers

Microservice Deployment in Space Computing Power Networks via Robust Reinforcement Learning

2025-01-08 · Zhiyong Yu, Yuning Jiang, Xin Liu, Yuanming Shi, Chunxiao Jiang, Linling Kuang

With the growing demand for Earth observation, it is important to provide reliable real-time remote sensing inference services to meet the low-latency requirements. The Space Computing Power Network (Space-CPN) offers a promising solution by providing onboard computing and extensive coverage capabilities for real-time inference. This paper presents a remote sensing artificial intelligence applications deployment framework designed for Low Earth Orbit satellite constellations to achieve real-time inference performance. The framework employs the microservice architecture, decomposing monolithic inference tasks into reusable, independent modules to address high latency and resource heterogeneity. This distributed approach enables optimized microservice deployment, minimizing resource utilization while meeting quality of service and functional requirements. We introduce Robust Optimization to the deployment problem to address data uncertainty. Additionally, we model the Robust Optimization problem as a Partially Observable Markov Decision Process and propose a robust reinforcement learning algorithm to handle the semi-infinite Quality of Service constraints. Our approach yields sub-optimal solutions that minimize accuracy loss while maintaining acceptable computational costs. Simulation results demonstrate the effectiveness of our framework.

📄 PDF Abstract BibTeX arXiv:2501.06244

Code (0)

등록된 구현이 없습니다.

Tasks

Earth Observation

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

Microservice Deployment in Edge Computing Based on Deep Q Learning

2022-02-11 · IEEE Transactions on Parallel and Distributed Systems 2022 2 · Wenkai Lv, Quan Wang, Pengfei Yang

The microservice deployment strategy is promising in reducing the overall service response time in the microservice-oriented edge computing platform. However, existing works ignore the effect of different interaction fre…

Edge-computingQ-Learning

How to Share: Balancing Layer and Chain Sharing in Industrial Microservice Deployment

2022-12-29 · Yuxiang Liu, Bo Yang, Yu Wu, Cailian Chen 외

With the rapid development of smart manufacturing, edge computing-oriented microservice platforms are emerging as an important part of production control. In the containerized deployment of microservices, layer sharing c…

Edge-computing

Digital Twin-assisted Reinforcement Learning for Resource-aware Microservice Offloading in Edge Computing

2024-03-13 · Xiangchun Chen, Jiannong Cao, Zhixuan Liang, Yuvraj Sahni 외

Collaborative edge computing (CEC) has emerged as a promising paradigm, enabling edge nodes to collaborate and execute microservices from end devices. Microservice offloading, a fundamentally important problem, decides w…

Deep Reinforcement LearningEdge-computing

Autonomous Resource Management in Microservice Systems via Reinforcement Learning

2025-07-17 · Yujun Zou, Nia Qi, Yingnan Deng, Zhihao Xue 외

This paper proposes a reinforcement learning-based method for microservice resource scheduling and optimization, aiming to address issues such as uneven resource allocation, high latency, and insufficient throughput in t…

Managementreinforcement-learningReinforcement LearningScheduling

Multi-Objective Adaptive Rate Limiting in Microservices Using Deep Reinforcement Learning

2025-11-05 · Ning Lyu, Yuxi Wang, Ziyu Cheng, Qingyuan Zhang 외 arxiv

As cloud computing and microservice architectures become increasingly prevalent, API rate limiting has emerged as a critical mechanism for ensuring system stability and service quality. Traditional rate limiting algorith…

Reinforcement Learning