Neural Style Transfer via Meta Networks
In this paper we propose a noval method to generate the specified network parameters through one feed-forward propagation in the meta networks for neural style transfer. Recent works on style transfer typically need to train image transformation networks for every new style, and the style is encoded in the network parameters by enormous iterations of stochastic gradient descent, which lacks the generalization ability to new style in the inference stage. To tackle these issues, we build a meta network which takes in the style image and generates a corresponding image transformation network directly. Compared with optimization-based methods for every style, our meta networks can handle an arbitrary new style within 19 milliseconds on one modern GPU card. The fast image transformation network generated by our meta network is only 449 KB, which is capable of real-time running on a mobile device. We also investigate the manifold of the style transfer networks by operating the hidden features from meta networks. Experiments have well validated the effectiveness of our method. Code and trained models will be released.
Code (0)
등록된 구현이 없습니다.
Tasks
GPUStyle TransferSimilar Papers 제목 키워드 기반
Meta Networks for Neural Style Transfer
In this paper we propose a new method to get the specified network parameters through one time feed-forward propagation of the meta networks and explore the application to neural style transfer. Recent works on style tra…
GPUStyle TransferST$^2$: Small-data Text Style Transfer via Multi-task Meta-Learning
Text style transfer aims to paraphrase a sentence in one style into another style while preserving content. Due to lack of parallel training data, state-of-art methods are unsupervised and rely on large datasets that sha…
Meta-LearningSentenceSmall Data Image ClassificationStyle Transfer+1Network of Steel: Neural Font Style Transfer from Heavy Metal to Corporate Logos
We introduce a method for transferring style from the logos of heavy metal bands onto corporate logos using a VGG16 network. We establish the contribution of different layers and loss coefficients to the learning of styl…
Font Style TransferStyle TransferMeta-Voice: Fast few-shot style transfer for expressive voice cloning using meta learning
The task of few-shot style transfer for voice cloning in text-to-speech (TTS) synthesis aims at transferring speaking styles of an arbitrary source speaker to a target speaker's voice using very limited amount of neutral…
DisentanglementMeta-LearningStyle Transfertext-to-speech+2Low Resource Style Transfer via Domain Adaptive Meta Learning
Text style transfer (TST) without parallel data has achieved some practical success. However, most of the existing unsupervised text style transfer methods suffer from (i) requiring massive amounts of nonparallel data t…
General KnowledgeLanguage ModelingLanguage ModellingMeta-Learning+3