MTL-Split: Multi-Task Learning for Edge Devices using Split Computing
Split Computing (SC), where a Deep Neural Network (DNN) is intelligently split with a part of it deployed on an edge device and the rest on a remote server is emerging as a promising approach. It allows the power of DNNs to be leveraged for latency-sensitive applications that do not allow the entire DNN to be deployed remotely, while not having sufficient computation bandwidth available locally. In many such embedded systems scenarios, such as those in the automotive domain, computational resource constraints also necessitate Multi-Task Learning (MTL), where the same DNN is used for multiple inference tasks instead of having dedicated DNNs for each task, which would need more computing bandwidth. However, how to partition such a multi-tasking DNN to be deployed within a SC framework has not been sufficiently studied. This paper studies this problem, and MTL-Split, our novel proposed architecture, shows encouraging results on both synthetic and real-world data. The source code is available at https://github.com/intelligolabs/MTL-Split.
Code (1)
Tasks
Multi-Task LearningSimilar Papers 제목 키워드 기반
A Multi-task Supervised Compression Model for Split Computing
Split computing ($\neq$ split learning) is a promising approach to deep learning models for resource-constrained edge computing systems, where weak sensor (mobile) devices are wirelessly connected to stronger edge server…
Edge-computingimage-classificationImage Classificationobject-detection+2Dynamic Split Computing for Efficient Deep Edge Intelligence
Deploying deep neural networks (DNNs) on IoT and mobile devices is a challenging task due to their limited computational resources. Thus, demanding tasks are often entirely offloaded to edge servers which can accelerate …
Edge-computingHyperparameter OptimizationReinDSplit: Reinforced Dynamic Split Learning for Pest Recognition in Precision Agriculture
To empower precision agriculture through distributed machine learning (DML), split learning (SL) has emerged as a promising paradigm, partitioning deep neural networks (DNNs) between edge devices and servers to reduce co…
Q-LearningReinforcement Learning (RL)Completion Time Minimization of Fog-RAN-Assisted Federated Learning With Rate-Splitting Transmission
This work studies federated learning (FL) over a fog radio access network, in which multiple internet-of-things (IoT) devices cooperatively learn a shared machine learning model by communicating with a cloud server (CS) …
Federated LearningQuantization3D Point Cloud Object Detection on Edge Devices for Split Computing
The field of autonomous driving technology is rapidly advancing, with deep learning being a key component. Particularly in the field of sensing, 3D point cloud data collected by LiDAR is utilized to run deep neural netwo…
3D Object DetectionAutonomous Driving