paper-with-me

홈 › Papers

Intelligent Painter: Picture Composition With Resampling Diffusion Model

2022-10-31 · Wing-Fung Ku, Wan-Chi Siu, Xi Cheng, H. Anthony Chan

Have you ever thought that you can be an intelligent painter? This means that you can paint a picture with a few expected objects in mind, or with a desirable scene. This is different from normal inpainting approaches for which the location of specific objects cannot be determined. In this paper, we present an intelligent painter that generate a person's imaginary scene in one go, given explicit hints. We propose a resampling strategy for Denoising Diffusion Probabilistic Model (DDPM) to intelligently compose unconditional harmonized pictures according to the input subjects at specific locations. By exploiting the diffusion property, we resample efficiently to produce realistic pictures. Experimental results show that our resampling method favors the semantic meaning of the generated output efficiently and generates less blurry output. Quantitative analysis of image quality assessment shows that our method produces higher perceptual quality images compared with the state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2210.17106

Code (1)

vinesmsuic/ipainter-diffusion 공식 구현 pytorch

Tasks

DenoisingImage Quality Assessmentmodel

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.

Similar Papers 제목 키워드 기반

Restyling Images with the Bangladeshi Paintings Using Neural Style Transfer: A Comprehensive Experiment, Evaluation, and Human Perspective

2020-12-10 · Manal, Ali Hasan Md. Linkon, Md. Mahir Labib, Marium-E-Jannat 외

In today's world, Neural Style Transfer (NST) has become a trendsetting term. NST combines two pictures, a content picture and a reference image in style (such as the work of a renowned painter) in a way that makes the o…

Style Transfer

PainterNet: Adaptive Image Inpainting with Actual-Token Attention and Diverse Mask Control

2024-12-02 · Ruichen Wang, Junliang Zhang, Qingsong Xie, Chen Chen 외

Recently, diffusion models have exhibited superior performance in the area of image inpainting. Inpainting methods based on diffusion models can usually generate realistic, high-quality image content for masked areas. Ho…

Image Inpainting

FlowPainter: Inpainting Optical Flow via Confidence-Guided Completion

2026-07-11 · Yuang Meng, Chenyang Wu, Xianshun Liu, Chun-Le Guo 외 arxiv

Existing optical flow methods broadly follow two paradigms: iterative optimization and diffusion-based estimation. Iterative methods, exemplified by RAFT, achieve high accuracy through recurrent refinement, but remain ch…

Optical Flow Estimation

DiTPainter: Efficient Video Inpainting with Diffusion Transformers

2025-04-22 · Xian Wu, Chang Liu

Many existing video inpainting algorithms utilize optical flows to construct the corresponding maps and then propagate pixels from adjacent frames to missing areas by mapping. Despite the effectiveness of the propagation…

Video GenerationVideo Inpainting

Painterly Image Harmonization using Diffusion Model

2023-08-04 · Lingxiao Lu, Jiangtong Li, Junyan Cao, Li Niu 외

Painterly image harmonization aims to insert photographic objects into paintings and obtain artistically coherent composite images. Previous methods for this task mainly rely on inference optimization or generative adver…

Generative Adversarial NetworkImage HarmonizationInference Optimizationmodel