RoboECC: Multi-Factor-Aware Edge-Cloud Collaborative Deployment for VLA Models
Vision-Language-Action (VLA) models are mainstream in embodied intelligence but face high inference costs. Edge-Cloud Collaborative (ECC) deployment offers an effective fix by easing edge-device computing pressure to meet real-time needs. However, existing ECC frameworks are suboptimal for VLA models due to two challenges: (1) Diverse model structures hinder optimal ECC segmentation point identification; (2) Even if the optimal split point is determined, changes in network bandwidth can cause performance drift. To address these issues, we propose a novel ECC deployment framework for various VLA models, termed RoboECC. Specifically, we propose a model-hardware co-aware segmentation strategy to help find the optimal segmentation point for various VLA models. Moreover, we propose a network-aware deployment adjustment approach to adapt to the network fluctuations for maintaining optimal performance. Experiments demonstrate that RoboECC achieves a speedup of up to 3.28x with only 2.55%~2.62% overhead.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Multi-to-Single Knowledge Distillation for Point Cloud Semantic Segmentation
3D point cloud semantic segmentation is one of the fundamental tasks for environmental understanding. Although significant progress has been made in recent years, the performance of classes with few examples or few point…
Knowledge DistillationSemantic SegmentationEdgeRec: Recommender System on Edge in Mobile Taobao
Recommender system (RS) has become a crucial module in most web-scale applications. Recently, most RSs are in the waterfall form based on the cloud-to-edge framework, where recommended results are transmitted to edge (e.…
Recommendation SystemsRerankingEdge Aware Learning for 3D Point Cloud
This paper proposes an innovative approach to Hierarchical Edge Aware 3D Point Cloud Learning (HEA-Net) that seeks to address the challenges of noise in point cloud data, and improve object recognition and segmentation b…
ObjectObject RecognitionPoint Cloud ClassificationSegmentationParameter- and Bandwidth-Efficient Edge--cloud Many-to-Many Speech-to-Text Translation
Multimodal large language models (MLLMs) have demonstrated significant potential for speech-to-text translation (S2TT). However, existing deployment paradigms face critical challenges: pure on-device models suffer from r…
Speech-to-Text TranslationSpeech RecognitionEC-Net: an Edge-aware Point set Consolidation Network
Point clouds obtained from 3D scans are typically sparse, irregular, and noisy, and required to be consolidated. In this paper, we present the first deep learning based edge-aware technique to facilitate the consolidatio…
Surface Reconstruction