paper-with-me

Papers

Neural Painters: A learned differentiable constraint for generating brushstroke paintings

2019-04-17 · Reiichiro Nakano

We explore neural painters, a generative model for brushstrokes learned from a real non-differentiable and non-deterministic painting program. We show that when training an agent to "paint" images using brushstrokes, using a differentiable neural painter leads to much faster convergence. We propose a method for encouraging this agent to follow human-like strokes when reconstructing digits. We also explore the use of a neural painter as a differentiable image parameterization. By directly optimizing brushstrokes to activate neurons in a pre-trained convolutional network, we can directly visualize ImageNet categories and generate "ideal" paintings of each class. Finally, we present a new concept called intrinsic style transfer. By minimizing only the content loss from neural style transfer, we allow the artistic medium, in this case, brushstrokes, to naturally dictate the resulting style.

📄 PDF Abstract BibTeX arXiv:1904.08410

Code (4)

reiinakano/neural-painters-pytorch 공식 구현 pytorch
libreai/neural-painters-x tf
shauray8/Neural-Painter pytorch
t04glovern/neural-painters

Tasks

Style Transfer

Similar Papers 제목 키워드 기반

ProcessPainter: Learn Painting Process from Sequence Data

2024-06-10 · Yiren Song, Shijie Huang, Chen Yao, Xiaojun Ye 외

The painting process of artists is inherently stepwise and varies significantly among different painters and styles. Generating detailed, step-by-step painting processes is essential for art education and research, yet r…

DenoisingImage Generation

The Joy of Neural Painting

2021-11-19 · Ernesto Diaz-Aviles, Claudia Orellana-Rodriguez, Beth Jochim

Neural Painters is a class of models that follows a GAN framework to generate brushstrokes, which are then composed to create paintings. GANs are great generative models for AI Art but they are known to be notoriously di…

Transfer Learning

Rethinking Style Transfer: From Pixels to Parameterized Brushstrokes

2021-03-31 · CVPR 2021 1 · Dmytro Kotovenko, Matthias Wright, Arthur Heimbrecht, Björn Ommer

There have been many successful implementations of neural style transfer in recent years. In most of these works, the stylization process is confined to the pixel domain. However, we argue that this representation is unn…

Style Transfer

PaintCopilot: Modeling Painting as Autonomous Artistic Continuation

2026-05-20 · Yunge Wen, Yuancheng Shen, Paul Pu Liang arxiv

We present PaintCopilot, a co-creative neural painting assistant that models painting as an open-ended autoregressive artistic behavior conditioned on evolving canvas states and prior brushstroke history, without requiri…

Data-Efficient Brushstroke Generation with Diffusion Models for Oil Painting

2026-03-01 · Dantong Qin, Alessandro Bozzon, Xian Yang, Xun Zhang 외 arxiv

Many creative multimedia systems are built upon visual primitives such as strokes or textures, which are difficult to collect at scale and fundamentally different from natural image data. This data scarcity makes it chal…