Characterising Across-Stack Optimisations for Deep Convolutional Neural Networks
Convolutional Neural Networks (CNNs) are extremely computationally demanding, presenting a large barrier to their deployment on resource-constrained devices. Since such systems are where some of their most useful applications lie (e.g. obstacle detection for mobile robots, vision-based medical assistive technology), significant bodies of work from both machine learning and systems communities have attempted to provide optimisations that will make CNNs available to edge devices. In this paper we unify the two viewpoints in a Deep Learning Inference Stack and take an across-stack approach by implementing and evaluating the most common neural network compression techniques (weight pruning, channel pruning, and quantisation) and optimising their parallel execution with a range of programming approaches (OpenMP, OpenCL) and hardware architectures (CPU, GPU). We provide comprehensive Pareto curves to instruct trade-offs under constraints of accuracy, execution time, and memory space.
Code (1)
Tasks
CPUGPUNeural Network CompressionSimilar Papers 제목 키워드 기반
Geometric insights into robust portfolio construction
We investigate and extend the result that an alpha-weight angle from unconstrained quadratic portfolio optimisations has an upper bound dependent on the condition number of the covariance matrix. This is known to imply t…
Comparison of Optimised Geometric Deep Learning Architectures, over Varying Toxicological Assay Data Environments
Geometric deep learning is an emerging technique in Artificial Intelligence (AI) driven cheminformatics, however the unique implications of different Graph Neural Network (GNN) architectures are poorly explored, for this…
Binary ClassificationGraph Neural NetworkOptimisation of a Siamese Neural Network for Real-Time Energy Efficient Object Tracking
In this paper the research on optimisation of visual object tracking using a Siamese neural network for embedded vision systems is presented. It was assumed that the solution shall operate in real-time, preferably for a …
Object TrackingVisual Object TrackingEfficient Sparse Secure Aggregation for Federated Learning
Federated Learning enables one to jointly train a machine learning model across distributed clients holding sensitive datasets. In real-world settings, this approach is hindered by expensive communication and privacy con…
Federated LearningRevisiting Fully Convolutional Geometric Features for Object 6D Pose Estimation
Recent works on 6D object pose estimation focus on learning keypoint correspondences between images and object models, and then determine the object pose through RANSAC-based algorithms or by directly regressing the pose…
6D Pose Estimation6D Pose Estimation using RGBObjectPose Estimation