Microservice Deployment in Space Computing Power Networks via Robust Reinforcement Learning
With the growing demand for Earth observation, it is important to provide reliable real-time remote sensing inference services to meet the low-latency requirements. The Space Computing Power Network (Space-CPN) offers a promising solution by providing onboard computing and extensive coverage capabilities for real-time inference. This paper presents a remote sensing artificial intelligence applications deployment framework designed for Low Earth Orbit satellite constellations to achieve real-time inference performance. The framework employs the microservice architecture, decomposing monolithic inference tasks into reusable, independent modules to address high latency and resource heterogeneity. This distributed approach enables optimized microservice deployment, minimizing resource utilization while meeting quality of service and functional requirements. We introduce Robust Optimization to the deployment problem to address data uncertainty. Additionally, we model the Robust Optimization problem as a Partially Observable Markov Decision Process and propose a robust reinforcement learning algorithm to handle the semi-infinite Quality of Service constraints. Our approach yields sub-optimal solutions that minimize accuracy loss while maintaining acceptable computational costs. Simulation results demonstrate the effectiveness of our framework.
Code (0)
등록된 구현이 없습니다.
Tasks
Earth ObservationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Microservice Deployment in Edge Computing Based on Deep Q Learning
The microservice deployment strategy is promising in reducing the overall service response time in the microservice-oriented edge computing platform. However, existing works ignore the effect of different interaction fre…
Edge-computingQ-LearningHow to Share: Balancing Layer and Chain Sharing in Industrial Microservice Deployment
With the rapid development of smart manufacturing, edge computing-oriented microservice platforms are emerging as an important part of production control. In the containerized deployment of microservices, layer sharing c…
Edge-computingDigital Twin-assisted Reinforcement Learning for Resource-aware Microservice Offloading in Edge Computing
Collaborative edge computing (CEC) has emerged as a promising paradigm, enabling edge nodes to collaborate and execute microservices from end devices. Microservice offloading, a fundamentally important problem, decides w…
Deep Reinforcement LearningEdge-computingAutonomous Resource Management in Microservice Systems via Reinforcement Learning
This paper proposes a reinforcement learning-based method for microservice resource scheduling and optimization, aiming to address issues such as uneven resource allocation, high latency, and insufficient throughput in t…
Managementreinforcement-learningReinforcement LearningSchedulingMulti-Objective Adaptive Rate Limiting in Microservices Using Deep Reinforcement Learning
As cloud computing and microservice architectures become increasingly prevalent, API rate limiting has emerged as a critical mechanism for ensuring system stability and service quality. Traditional rate limiting algorith…
Reinforcement Learning