paper-with-me

Papers

ECAvg: An Edge-Cloud Collaborative Learning Approach using Averaged Weights

2023-10-05 · Atah Nuh Mih, Hung Cao, Asfia Kawnine, Monica Wachowicz

The use of edge devices together with cloud provides a collaborative relationship between both classes of devices where one complements the shortcomings of the other. Resource-constraint edge devices can benefit from the abundant computing power provided by servers by offloading computationally intensive tasks to the server. Meanwhile, edge devices can leverage their close proximity to the data source to perform less computationally intensive tasks on the data. In this paper, we propose a collaborative edge-cloud paradigm called ECAvg in which edge devices pre-train local models on their respective datasets and transfer the models to the server for fine-tuning. The server averages the pre-trained weights into a global model, which is fine-tuned on the combined data from the various edge devices. The local (edge) models are then updated with the weights of the global (server) model. We implement a CIFAR-10 classification task using MobileNetV2, a CIFAR-100 classification task using ResNet50, and an MNIST classification using a neural network with a single hidden layer. We observed performance improvement in the CIFAR-10 and CIFAR-100 classification tasks using our approach, where performance improved on the server model with averaged weights and the edge models had a better performance after model update. On the MNIST classification, averaging weights resulted in a drop in performance on both the server and edge models due to negative transfer learning. From the experiment results, we conclude that our approach is successful when implemented on deep neural networks such as MobileNetV2 and ResNet50 instead of simple neural networks.

📄 PDF Abstract BibTeX arXiv:2310.03823

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationTransfer Learning

Methods 이 논문이 사용한 방법론

Batch Normalization 설명 없음
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Average Pooling 설명 없음
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Inverted Residual Block 설명 없음

Similar Papers 제목 키워드 기반

KubeEdge-Sedna v0.3: Towards Next-Generation Automatically Customized AI Engineering Scheme

2023-03-08 · Zimu Zheng

The scale of the global edge AI market continues to grow. The current technical challenges that hinder the large-scale replication of edge AI are mainly small samples on the edge and heterogeneity of edge data. In additi…

Lifelong learningTransfer Learning

Root Cause Localization for Microservice Systems in Cloud-edge Collaborative Environments

2024-06-19 · Yuhan Zhu, Jian Wang, Bing Li, Xuxian Tang 외

With the development of cloud-native technologies, microservice-based software systems face challenges in accurately localizing root causes when failures occur. Additionally, the cloud-edge collaborative environment intr…

Graph Neural Network

Auto-Split: A General Framework of Collaborative Edge-Cloud AI

2021-08-30 · Amin Banitalebi-Dehkordi, Naveen Vedula, Jian Pei, Fei Xia 외

In many industry scale applications, large and resource consuming machine learning models reside in powerful cloud servers. At the same time, large amounts of input data are collected at the edge of cloud. The inference …

An Efficient Split Fine-tuning Framework for Edge and Cloud Collaborative Learning

2022-11-30 · Shaohuai Shi, Qing Yang, Yang Xiang, Shuhan Qi 외

To enable the pre-trained models to be fine-tuned with local data on edge devices without sharing data with the cloud, we design an efficient split fine-tuning (SFT) framework for edge and cloud collaborative learning. W…

CDC: Classification Driven Compression for Bandwidth Efficient Edge-Cloud Collaborative Deep Learning

2020-05-04 · Yuanrui Dong, Peng Zhao, Hanqiao Yu, Cong Zhao 외

The emerging edge-cloud collaborative Deep Learning (DL) paradigm aims at improving the performance of practical DL implementations in terms of cloud bandwidth consumption, response latency, and data privacy preservation…

ClassificationGeneral ClassificationQuantization