A Flexible Convolutional Solver with Application to Photorealistic Style Transfer
We propose a new flexible deep convolutional neural network (convnet) to perform fast visual style transfer. In contrast to existing convnets that address the same task, our architecture derives directly from the structure of the gradient descent originally used to solve the style transfer problem [Gatys et al., 2016]. Like existing convnets, ours approximately solves the original problem much faster than the gradient descent. However, our network is uniquely flexible by design: it can be manipulated at runtime to enforce new constraints on the final solution. In particular, we show how to modify it to obtain a photorealistic result with no retraining. We study the modifications made by [Luan et al., 2017] to the original cost function of [Gatys et al., 2016] to achieve photorealistic style transfer. These modifications affect directly the gradient descent and can be reported on-the-fly in our network. These modifications are possible as the proposed architecture stems from unrolling the gradient descent.
Code (0)
등록된 구현이 없습니다.
Tasks
Rolling Shutter CorrectionStyle TransferSimilar Papers 제목 키워드 기반
A Flexible Convolutional Solver for Fast Style Transfers
We propose a new flexible deep convolutional neural network (convnet) to perform fast neural style transfers. Our network is trained to solve approximately, but rapidly, the artistic style transfer problem of [Gatys et a…
Rolling Shutter CorrectionStyle TransferVideo Style TransferPICTURE: PhotorealistIC virtual Try-on from UnconstRained dEsigns
In this paper, we propose a novel virtual try-on from unconstrained designs (ucVTON) task to enable photorealistic synthesis of personalized composite clothing on input human images. Unlike prior arts constrained by spec…
DisentanglementHuman ParsingVirtual Try-onMultimodal 3D LUT Generation via StatLUT with Statistical Features for Photorealistic Style Transfer
Photorealistic Style Transfer (PST) aims to transfer the color and tonal style of a reference to a content image while strictly preserving its structural integrity. However, existing deep learning-based methods inherentl…
Style TransferDeep Translation Prior: Test-time Training for Photorealistic Style Transfer
Recent techniques to solve photorealistic style transfer within deep convolutional neural networks (CNNs) generally require intensive training from large-scale datasets, thus having limited applicability and poor general…
Style TransferTranslationTowards Controllable and Photorealistic Region-wise Image Manipulation
Adaptive and flexible image editing is a desirable function of modern generative models. In this work, we present a generative model with auto-encoder architecture for per-region style manipulation. We apply a code consi…
DisentanglementImage ManipulationStyle Transfer