paper-with-me

홈 › Papers

Tiny Updater: Towards Efficient Neural Network-Driven Software Updating

2023-01-01 · ICCV 2023 1 · Linfeng Zhang, Kaisheng Ma

Significant advancements have been accomplished with deep neural networks in diverse visual tasks, which have substantially elevated their deployment in edge device software. However, during the update of neural network-based software, users are required to download all the parameters of the neural network anew, which harms the user experience. Motivated by previous progress in model compression, we propose a novel training methodology named Tiny Updater to address this issue. Specifically, by adopting the variant of pruning and knowledge distillation methods, Tiny Updater can update the neural network-based software by only downloading a few parameters (10% 20%) instead of all the parameters in the neural network. Experiments on eleven datasets of three tasks, including image classification, image-to-image translation, and video recognition have demonstrated its effectiveness. Codes have been released in https://github.com/ArchipLab-LinfengZhang/TinyUpdater.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Efficient Neural Networkimage-classificationImage ClassificationImage-to-Image TranslationKnowledge DistillationModel CompressionVideo Recognition

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Learning to Update Knowledge Graphs by Reading News

2019-11-01 · IJCNLP 2019 11 · Jizhi Tang, Yansong Feng, Dongyan Zhao

News streams contain rich up-to-date information which can be used to update knowledge graphs (KGs). Most current text-based KG updating methods rely on elaborately designed information extraction (IE) systems and carefu…

Knowledge Graphs

High-Performance Long-Term Tracking with Meta-Updater

2020-04-01 · CVPR 2020 6 · Kenan Dai, Yunhua Zhang, Dong Wang, Jianhua Li 외

Long-term visual tracking has drawn increasing attention because it is much closer to practical applications than short-term tracking. Most top-ranked long-term trackers adopt the offline-trained Siamese architectures, t…

Visual Object TrackingVisual TrackingVocal Bursts Intensity Prediction

iLoRE: Dynamic Graph Representation with Instant Long-term Modeling and Re-occurrence Preservation

2023-09-05 · Siwei Zhang, Yun Xiong, Yao Zhang, Xixi Wu 외

Continuous-time dynamic graph modeling is a crucial task for many real-world applications, such as financial risk management and fraud detection. Though existing dynamic graph modeling methods have achieved satisfactory …

Fraud DetectionRepresentation Learning

From Tiny Machine Learning to Tiny Deep Learning: A Survey

2025-06-21 · Shriyank Somvanshi, Md Monzurul Islam, Gaurab Chhetri, Rohit Chakraborty 외

The rapid growth of edge devices has driven the demand for deploying artificial intelligence (AI) at the edge, giving rise to Tiny Machine Learning (TinyML) and its evolving counterpart, Tiny Deep Learning (TinyDL). Whil…

AutoMLModel OptimizationNeural Architecture SearchQuantization+1

Supporting AI Engineering on the IoT Edge through Model-Driven TinyML

2021-07-06 · Armin Moin, Moharram Challenger, Atta Badii, Stephan Günnemann

Software engineering of network-centric Artificial Intelligence (AI) and Internet of Things (IoT) enabled Cyber-Physical Systems (CPS) and services, involves complex design and validation challenges. In this paper, we pr…