paper-with-me

Papers

Conditional Human Sketch Synthesis with Explicit Abstraction Control

2023-06-15 · Dar-Yen Chen

This paper presents a novel free-hand sketch synthesis approach addressing explicit abstraction control in class-conditional and photo-to-sketch synthesis. Abstraction is a vital aspect of sketches, as it defines the fundamental distinction between a sketch and an image. Previous works relied on implicit control to achieve different levels of abstraction, leading to inaccurate control and synthesized sketches deviating from human sketches. To resolve this challenge, we propose two novel abstraction control mechanisms, state embeddings and the stroke token, integrated into a transformer-based latent diffusion model (LDM). These mechanisms explicitly provide the required amount of points or strokes to the model, enabling accurate point-level and stroke-level control in synthesized sketches while preserving recognizability. Outperforming state-of-the-art approaches, our method effectively generates diverse, non-rigid and human-like sketches. The proposed approach enables coherent sketch synthesis and excels in representing human habits with desired abstraction levels, highlighting the potential of sketch synthesis for real-world applications.

📄 PDF Abstract BibTeX arXiv:2306.09274

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Latent Diffusion Model Diffusion models applied to latent spaces, which are normally built with (Variational) Autoencoders.

Similar Papers 제목 키워드 기반

Learning Deep Sketch Abstraction

2018-04-13 · CVPR 2018 6 · Umar Riaz Muhammad, Yongxin Yang, Yi-Zhe Song, Tao Xiang 외

Human free-hand sketches have been studied in various contexts including sketch recognition, synthesis and fine-grained sketch-based image retrieval (FG-SBIR). A fundamental challenge for sketch analysis is to deal with …

Image RetrievalReinforcement LearningRetrievalSketch-Based Image Retrieval+1

Unsupervised Sketch to Photo Synthesis

2020-08-01 · ECCV 2020 8 · Runtao Liu, Qian Yu, Stella X. Yu

Humans can envision a realistic photo given a free-hand sketch that is not only spatially imprecise and geometrically distorted but also without colors and visual details. We study unsupervised sketch to photo synthesis …

DenoisingImage RetrievalRetrievalSketch-Based Image Retrieval+1

Unsupervised Sketch-to-Photo Synthesis

2019-09-18 · Runtao Liu, Qian Yu, Stella Yu

Humans can envision a realistic photo given a free-hand sketch that is not only spatially imprecise and geometrically distorted but also without colors and visual details. We study unsupervised sketch-to-photo synthesis …

ColorizationData AugmentationDenoisingImage Generation+4

SketchAA: Abstract Representation for Abstract Sketches

2021-01-01 · ICCV 2021 10 · Lan Yang, Kaiyue Pang, Honggang Zhang, Yi-Zhe Song

What makes free-hand sketches appealing for humans lies with its capability as a universal tool to depict the visual world. Such flexibility at human ease, however, introduces abstract renderings that pose unique cha…

Image RetrievalRetrievalSketch-Based Image RetrievalSketch Recognition

Sketch-a-Net that Beats Humans

2015-01-30 · Qian Yu, Yongxin Yang, Yi-Zhe Song, Tao Xiang 외

We propose a multi-scale multi-channel deep neural network framework that, for the first time, yields sketch recognition performance surpassing that of humans. Our superior performance is a result of explicitly embedding…

Sketch Recognition