Network Offloading Policies for Cloud Robotics: a Learning-based Approach
Today's robotic systems are increasingly turning to computationally expensive models such as deep neural networks (DNNs) for tasks like localization, perception, planning, and object detection. However, resource-constrained robots, like low-power drones, often have insufficient on-board compute resources or power reserves to scalably run the most accurate, state-of-the art neural network compute models. Cloud robotics allows mobile robots the benefit of offloading compute to centralized servers if they are uncertain locally or want to run more accurate, compute-intensive models. However, cloud robotics comes with a key, often understated cost: communicating with the cloud over congested wireless networks may result in latency or loss of data. In fact, sending high data-rate video or LIDAR from multiple robots over congested networks can lead to prohibitive delay for real-time applications, which we measure experimentally. In this paper, we formulate a novel Robot Offloading Problem --- how and when should robots offload sensing tasks, especially if they are uncertain, to improve accuracy while minimizing the cost of cloud communication? We formulate offloading as a sequential decision making problem for robots, and propose a solution using deep reinforcement learning. In both simulations and hardware experiments using state-of-the art vision DNNs, our offloading strategy improves vision task performance by between 1.3-2.6x of benchmark offloading strategies, allowing robots the potential to significantly transcend their on-board sensing accuracy but with limited cost of cloud communication.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingDeep Reinforcement Learningobject-detectionObject DetectionReinforcement LearningSequential Decision MakingSimilar Papers 제목 키워드 기반
Knowledge Distillation for Mobile Edge Computation Offloading
Edge computation offloading allows mobile end devices to put execution of compute-intensive task on the edge servers. End devices can decide whether offload the tasks to edge servers, cloud servers or execute locally acc…
Imitation LearningKnowledge DistillationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONCloud-Assisted Remote Control for Aerial Robots: From Theory to Proof-of-Concept Implementation
Cloud robotics has emerged as a promising technology for robotics applications due to its advantages of offloading computationally intensive tasks, facilitating data sharing, and enhancing robot coordination. However, in…
Fast Adaptive Task Offloading in Edge Computing based on Meta Reinforcement Learning
Multi-access edge computing (MEC) aims to extend cloud service to the network edge to reduce network traffic and service latency. A fundamental problem in MEC is how to efficiently offload heterogeneous tasks of mobile a…
Deep Reinforcement LearningEdge-computingMeta Reinforcement Learningreinforcement-learning+2Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond
5G beyond is an end-edge-cloud orchestrated network that can exploit heterogeneous capabilities of the end devices, edge servers, and the cloud and thus has the potential to enable computation-intensive and delay-sensiti…
Deep Reinforcement LearningEdge Robotics: Edge-Computing-Accelerated Multi-Robot Simultaneous Localization and Mapping
With the wide penetration of smart robots in multifarious fields, Simultaneous Localization and Mapping (SLAM) technique in robotics has attracted growing attention in the community. Yet collaborating SLAM over multiple …
Edge-computingSimultaneous Localization and Mapping