paper-with-me

홈 › Papers

Birth of a Painting: Differentiable Brushstroke Reconstruction

2025-11-17 · Ying Jiang, Jiayin Lu, Yunuo Chen, Yumeng He, Kui Wu, Yin Yang, Chenfanfu Jiang arxiv

Painting embodies a unique form of visual storytelling, where the creation process is as significant as the final artwork. Although recent advances in generative models have enabled visually compelling painting synthesis, most existing methods focus solely on final image generation or patch-based process simulation, lacking explicit stroke structure and failing to produce smooth, realistic shading. In this work, we present a differentiable stroke reconstruction framework that unifies painting, stylized texturing, and smudging to faithfully reproduce the human painting-smudging loop. Given an input image, our framework first optimizes single- and dual-color Bezier strokes through a parallel differentiable paint renderer, followed by a style generation module that synthesizes geometry-conditioned textures across diverse painting styles. We further introduce a differentiable smudge operator to enable natural color blending and shading. Coupled with a coarse-to-fine optimization strategy, our method jointly optimizes stroke geometry, color, and texture under geometric and semantic guidance. Extensive experiments on oil, watercolor, ink, and digital paintings demonstrate that our approach produces realistic and expressive stroke reconstructions, smooth tonal transitions, and richly stylized appearances, offering a unified model for expressive digital painting creation. See our project page for more demos: https://yingjiang96.github.io/DiffPaintWebsite/.

📄 PDF Abstract BibTeX arXiv:2511.13191

Code (0)

등록된 구현이 없습니다.

Tasks

Visual StorytellingImage Generation

Similar Papers 제목 키워드 기반

Neural Painters: A learned differentiable constraint for generating brushstroke paintings

2019-04-17 · Reiichiro Nakano

We explore neural painters, a generative model for brushstrokes learned from a real non-differentiable and non-deterministic painting program. We show that when training an agent to "paint" images using brushstrokes, usi…

Style Transfer

PaintCopilot: Modeling Painting as Autonomous Artistic Continuation

2026-05-20 · Yunge Wen, Yuancheng Shen, Paul Pu Liang arxiv

We present PaintCopilot, a co-creative neural painting assistant that models painting as an open-ended autoregressive artistic behavior conditioned on evolving canvas states and prior brushstroke history, without requiri…

Rethinking Style Transfer: From Pixels to Parameterized Brushstrokes

2021-03-31 · CVPR 2021 1 · Dmytro Kotovenko, Matthias Wright, Arthur Heimbrecht, Björn Ommer

There have been many successful implementations of neural style transfer in recent years. In most of these works, the stylization process is confined to the pixel domain. However, we argue that this representation is unn…

Style Transfer

Artistic Style in Robotic Painting; a Machine Learning Approach to Learning Brushstroke from Human Artists

2020-07-07 · Ardavan Bidgoli, Manuel Ladron De Guevara, Cinnie Hsiung, Jean Oh 외

Robotic painting has been a subject of interest among both artists and roboticists since the 1970s. Researchers and interdisciplinary artists have employed various painting techniques and human-robot collaboration models…

BIG-bench Machine LearningStyle Transfer

Intelli-Paint: Towards Developing Human-like Painting Agents

2021-12-16 · Jaskirat Singh, Cameron Smith, Jose Echevarria, Liang Zheng

The generation of well-designed artwork is often quite time-consuming and assumes a high degree of proficiency on part of the human painter. In order to facilitate the human painting process, substantial research efforts…