paper-with-me

홈 › Papers

Adaptively-Realistic Image Generation from Stroke and Sketch with Diffusion Model

2022-08-26 · Shin-I Cheng, Yu-Jie Chen, Wei-Chen Chiu, Hung-Yu Tseng, Hsin-Ying Lee

Generating images from hand-drawings is a crucial and fundamental task in content creation. The translation is difficult as there exist infinite possibilities and the different users usually expect different outcomes. Therefore, we propose a unified framework supporting a three-dimensional control over the image synthesis from sketches and strokes based on diffusion models. Users can not only decide the level of faithfulness to the input strokes and sketches, but also the degree of realism, as the user inputs are usually not consistent with the real images. Qualitative and quantitative experiments demonstrate that our framework achieves state-of-the-art performance while providing flexibility in generating customized images with control over shape, color, and realism. Moreover, our method unleashes applications such as editing on real images, generation with partial sketches and strokes, and multi-domain multi-modal synthesis.

📄 PDF Abstract BibTeX arXiv:2208.12675

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationTranslation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Cali-Sketch: Stroke Calibration and Completion for High-Quality Face Image Generation from Human-Like Sketches

2019-11-01 · Weihao Xia, Yujiu Yang, Jing-Hao Xue

Image generation has received increasing attention because of its wide application in security and entertainment. Sketch-based face generation brings more fun and better quality of image generation due to supervised inte…

Face GenerationImage GenerationImage-to-Image TranslationTranslation

DeepFacePencil: Creating Face Images from Freehand Sketches

2020-08-31 · Yuhang Li, Xuejin Chen, Binxin Yang, Zihan Chen 외

In this paper, we explore the task of generating photo-realistic face images from hand-drawn sketches. Existing image-to-image translation methods require a large-scale dataset of paired sketches and images for supervisi…

DiversityImage-to-Image TranslationTranslation

Stroke2Sketch: Harnessing Stroke Attributes for Training-Free Sketch Generation

2025-10-18 · Rui Yang, Huining Li, Yiyi Long, Xiaojun Wu 외 arxiv

Generating sketches guided by reference styles requires precise transfer of stroke attributes, such as line thickness, deformation, and texture sparsity, while preserving semantic structure and content fidelity. To this …

VisioBlend: Sketch and Stroke-Guided Denoising Diffusion Probabilistic Model for Realistic Image Generation

2024-05-15 · Harshkumar Devmurari, Gautham Kuckian, Prajjwal Vishwakarma, Krunali Vartak

Generating images from hand-drawings is a crucial and fundamental task in content creation. The translation is challenging due to the infinite possibilities and the diverse expectations of users. However, traditional met…

DenoisingEfficient Diffusion PersonalizationImage Generation

3Doodle: Compact Abstraction of Objects with 3D Strokes

2024-02-06 · Changwoon Choi, Jaeah Lee, Jaesik Park, Young Min Kim

While free-hand sketching has long served as an efficient representation to convey characteristics of an object, they are often subjective, deviating significantly from realistic representations. Moreover, sketches are n…

Descriptive