Fast and Efficient DNN Deployment via Deep Gaussian Transfer Learning
Deep neural networks (DNNs) have been widely used recently while their hardware deployment optimizations are very time-consuming and the historical deployment knowledge is not utilized efficiently. In this paper, to accelerate the optimization process and find better deployment configurations, we propose a novel transfer learning method based on deep Gaussian processes (DGPs). Firstly, a deep Gaussian process (DGP) model is built on the historical data to learn empirical knowledge. Secondly, to transfer knowledge to a new task, a tuning set is sampled for the new task under the guidance of the DGP model. Then DGP is tuned according to the tuning set via maximum-a-posteriori (MAP) estimation to accommodate for the new task and finally used to guide the deployments of the task. The experiments show that our method achieves the best inference latencies of convolutions while accelerating the optimization process significantly, compared with previous arts.
Code (0)
등록된 구현이 없습니다.
Tasks
Gaussian ProcessesTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Optimization-Free Style Transfer for 3D Gaussian Splats
The task of style transfer for 3D Gaussian splats has been explored in many previous works, but these require reconstructing or fine-tuning the splat while incorporating style information or optimizing a feature extracti…
Style TransferRobust Registration of Gaussian Mixtures for Colour Transfer
We present a flexible approach to colour transfer inspired by techniques recently proposed for shape registration. Colour distributions of the palette and target images are modelled with Gaussian Mixture Models (GMMs) th…
Local Granger Causality
Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. For Gaussian variables it is equivalent to transfer entropy, an information-theoretic measure of time-directed …
Gaussian ProcessesPRTGaussian: Efficient Relighting Using 3D Gaussians with Precomputed Radiance Transfer
We present PRTGaussian, a realtime relightable novel-view synthesis method made possible by combining 3D Gaussians and Precomputed Radiance Transfer (PRT). By fitting relightable Gaussians to multi-view OLAT data, our me…
Computational EfficiencyNovel View SynthesisFAST-Splat: Fast, Ambiguity-Free Semantics Transfer in Gaussian Splatting
We present FAST-Splat for fast, ambiguity-free semantic Gaussian Splatting, which seeks to address the main limitations of existing semantic Gaussian Splatting methods, namely: slow training and rendering speeds; high me…
Dimensionality ReductionGPUNatural Language QueriesObject Localization+3