paper-with-me

Papers

StyleBank: An Explicit Representation for Neural Image Style Transfer

2017-03-27 · CVPR 2017 7 · Dongdong Chen, Lu Yuan, Jing Liao, Nenghai Yu, Gang Hua

We propose StyleBank, which is composed of multiple convolution filter banks and each filter bank explicitly represents one style, for neural image style transfer. To transfer an image to a specific style, the corresponding filter bank is operated on top of the intermediate feature embedding produced by a single auto-encoder. The StyleBank and the auto-encoder are jointly learnt, where the learning is conducted in such a way that the auto-encoder does not encode any style information thanks to the flexibility introduced by the explicit filter bank representation. It also enables us to conduct incremental learning to add a new image style by learning a new filter bank while holding the auto-encoder fixed. The explicit style representation along with the flexible network design enables us to fuse styles at not only the image level, but also the region level. Our method is the first style transfer network that links back to traditional texton mapping methods, and hence provides new understanding on neural style transfer. Our method is easy to train, runs in real-time, and produces results that qualitatively better or at least comparable to existing methods.

📄 PDF Abstract BibTeX arXiv:1703.09210

Code (2)

jxcodetw/stylebank pytorch
yujiachen-y/StyleBank pytorch

Tasks

Incremental LearningStyle Transfer

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

StyleRemix: An Interpretable Representation for Neural Image Style Transfer

2019-02-27 · Hongmin Xu, Qiang Li, Wenbo Zhang, Wen Zheng

Multi-Style Transfer (MST) intents to capture the high-level visual vocabulary of different styles and expresses these vocabularies in a joint model to transfer each specific style. Recently, Style Embedding Learning (SE…

Style Transfer

ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptation

2023-12-04 · CVPR 2024 1 · Dar-Yen Chen, Hamish Tennent, Ching-Wen Hsu

This work introduces ArtAdapter, a transformative text-to-image (T2I) style transfer framework that transcends traditional limitations of color, brushstrokes, and object shape, capturing high-level style elements such as…

Style Transfer

ALADIN-NST: Self-supervised disentangled representation learning of artistic style through Neural Style Transfer

2023-04-12 · Dan Ruta, Gemma Canet Tarres, Alexander Black, Andrew Gilbert 외

Representation learning aims to discover individual salient features of a domain in a compact and descriptive form that strongly identifies the unique characteristics of a given sample respective to its domain. Existing …

DescriptiveDisentanglementRepresentation LearningStyle Transfer

A Unified Framework for Generalizable Style Transfer: Style and Content Separation

2018-06-13 · Yexun Zhang, Ya zhang, Wenbin Cai

Image style transfer has drawn broad attention in recent years. However, most existing methods aim to explicitly model the transformation between different styles, and the learned model is thus not generalizable to new s…

DecoderMulti-Task LearningStyle Transfer

Image Style Transfer Using Convolutional Neural Networks

2016-06-01 · CVPR 2016 6 · Leon A. Gatys, Alexander S. Ecker, Matthias Bethge

Rendering the semantic content of an image in different styles is a difficult image processing task. Arguably, a major limiting factor for previous approaches has been the lack of image representations that explicitly re…

Image GenerationObject RecognitionStyle Transfer