paper-with-me

홈 › Papers

Learning to Sketch with Deep Q Networks and Demonstrated Strokes

2018-10-14 · Tao Zhou, Chen Fang, Zhaowen Wang, Jimei Yang, Byungmoon Kim, Zhili Chen, Jonathan Brandt, Demetri Terzopoulos

Doodling is a useful and common intelligent skill that people can learn and master. In this work, we propose a two-stage learning framework to teach a machine to doodle in a simulated painting environment via Stroke Demonstration and deep Q-learning (SDQ). The developed system, Doodle-SDQ, generates a sequence of pen actions to reproduce a reference drawing and mimics the behavior of human painters. In the first stage, it learns to draw simple strokes by imitating in supervised fashion from a set of strokeaction pairs collected from artist paintings. In the second stage, it is challenged to draw real and more complex doodles without ground truth actions; thus, it is trained with Qlearning. Our experiments confirm that (1) doodling can be learned without direct stepby- step action supervision and (2) pretraining with stroke demonstration via supervised learning is important to improve performance. We further show that Doodle-SDQ is effective at producing plausible drawings in different media types, including sketch and watercolor.

📄 PDF Abstract BibTeX arXiv:1810.05977

Code (0)

등록된 구현이 없습니다.

Tasks

Q-Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Refining Strokes by Learning Offset Attributes between Strokes for Flexible Sketch Edit at Stroke-Level

2026-01-31 · Sicong Zang, Tao Sun, Cairong Yan arxiv

Sketch edit at stroke-level aims to transplant source strokes onto a target sketch via stroke expansion or replacement, while preserving semantic consistency and visual fidelity with the target sketch. Recent studies add…

Strokes2Surface: Recovering Curve Networks From 4D Architectural Design Sketches

2023-06-12 · S. Rasoulzadeh, M. Wimmer, P. Stauss, I. Kovacic

We present Strokes2Surface, an offline geometry reconstruction pipeline that recovers well-connected curve networks from imprecise 4D sketches to bridge concept design and digital modeling stages in architectural design.…

Binary ClassificationClustering

Block and Detail: Scaffolding Sketch-to-Image Generation

2024-02-28 · Vishnu Sarukkai, Lu Yuan, Mia Tang, Maneesh Agrawala 외

We introduce a novel sketch-to-image tool that aligns with the iterative refinement process of artists. Our tool lets users sketch blocking strokes to coarsely represent the placement and form of objects and detail strok…

BlockingDataset GenerationImage Generation

VisioBlend: Sketch and Stroke-Guided Denoising Diffusion Probabilistic Model for Realistic Image Generation

2024-05-15 · Harshkumar Devmurari, Gautham Kuckian, Prajjwal Vishwakarma, Krunali Vartak

Generating images from hand-drawings is a crucial and fundamental task in content creation. The translation is challenging due to the infinite possibilities and the diverse expectations of users. However, traditional met…

DenoisingEfficient Diffusion PersonalizationImage Generation

AutoSketch: VLM-assisted Style-Aware Vector Sketch Completion

2025-02-07 · Hsiao-Yuan Chin, I-Chao Shen, Yi-Ting Chiu, Bing-Yu Chen

The ability to automatically complete a partial sketch that depicts a complex scene, e.g., "a woman chatting with a man in the park", is very useful. However, existing sketch generation methods create sketches from scrat…