Tiny Updater: Towards Efficient Neural Network-Driven Software Updating
Significant advancements have been accomplished with deep neural networks in diverse visual tasks, which have substantially elevated their deployment in edge device software. However, during the update of neural network-based software, users are required to download all the parameters of the neural network anew, which harms the user experience. Motivated by previous progress in model compression, we propose a novel training methodology named Tiny Updater to address this issue. Specifically, by adopting the variant of pruning and knowledge distillation methods, Tiny Updater can update the neural network-based software by only downloading a few parameters (10% 20%) instead of all the parameters in the neural network. Experiments on eleven datasets of three tasks, including image classification, image-to-image translation, and video recognition have demonstrated its effectiveness. Codes have been released in https://github.com/ArchipLab-LinfengZhang/TinyUpdater.
Code (0)
등록된 구현이 없습니다.
Tasks
Efficient Neural Networkimage-classificationImage ClassificationImage-to-Image TranslationKnowledge DistillationModel CompressionVideo RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning to Update Knowledge Graphs by Reading News
News streams contain rich up-to-date information which can be used to update knowledge graphs (KGs). Most current text-based KG updating methods rely on elaborately designed information extraction (IE) systems and carefu…
Knowledge GraphsHigh-Performance Long-Term Tracking with Meta-Updater
Long-term visual tracking has drawn increasing attention because it is much closer to practical applications than short-term tracking. Most top-ranked long-term trackers adopt the offline-trained Siamese architectures, t…
Visual Object TrackingVisual TrackingVocal Bursts Intensity PredictioniLoRE: Dynamic Graph Representation with Instant Long-term Modeling and Re-occurrence Preservation
Continuous-time dynamic graph modeling is a crucial task for many real-world applications, such as financial risk management and fraud detection. Though existing dynamic graph modeling methods have achieved satisfactory …
Fraud DetectionRepresentation LearningFrom Tiny Machine Learning to Tiny Deep Learning: A Survey
The rapid growth of edge devices has driven the demand for deploying artificial intelligence (AI) at the edge, giving rise to Tiny Machine Learning (TinyML) and its evolving counterpart, Tiny Deep Learning (TinyDL). Whil…
AutoMLModel OptimizationNeural Architecture SearchQuantization+1Supporting AI Engineering on the IoT Edge through Model-Driven TinyML
Software engineering of network-centric Artificial Intelligence (AI) and Internet of Things (IoT) enabled Cyber-Physical Systems (CPS) and services, involves complex design and validation challenges. In this paper, we pr…