paper-with-me

Papers

Deep Image Compositing

2020-11-04 · He Zhang, Jianming Zhang, Federico Perazzi, Zhe Lin, Vishal M. Patel

Image compositing is a task of combining regions from different images to compose a new image. A common use case is background replacement of portrait images. To obtain high quality composites, professionals typically manually perform multiple editing steps such as segmentation, matting and foreground color decontamination, which is very time consuming even with sophisticated photo editing tools. In this paper, we propose a new method which can automatically generate high-quality image compositing without any user input. Our method can be trained end-to-end to optimize exploitation of contextual and color information of both foreground and background images, where the compositing quality is considered in the optimization. Specifically, inspired by Laplacian pyramid blending, a dense-connected multi-stream fusion network is proposed to effectively fuse the information from the foreground and background images at different scales. In addition, we introduce a self-taught strategy to progressively train from easy to complex cases to mitigate the lack of training data. Experiments show that the proposed method can automatically generate high-quality composites and outperforms existing methods both qualitatively and quantitatively.

📄 PDF Abstract BibTeX arXiv:2011.02146

Code (0)

등록된 구현이 없습니다.

Tasks

Image Matting

Methods 이 논문이 사용한 방법론

Laplacian Pyramid 설명 없음

Similar Papers 제목 키워드 기반

Instance Segmentation based Semantic Matting for Compositing Applications

2019-04-10 · Guanqing Hu, James J. Clark

Image compositing is a key step in film making and image editing that aims to segment a foreground object and combine it with a new background. Automatic image compositing can be done easily in a studio using chroma-keyi…

Image MattingInstance SegmentationSemantic Image MattingSemantic Segmentation

Deep Image Compositing

2021-03-29 · Shivangi Aneja, Soham Mazumder

In image editing, the most common task is pasting objects from one image to the other and then eventually adjusting the manifestation of the foreground object with the background object. This task is called image composi…

Benchmarking

Thinking Outside the BBox: Unconstrained Generative Object Compositing

2024-09-06 · Gemma Canet Tarrés, Zhe Lin, Zhifei Zhang, Jianming Zhang 외

Compositing an object into an image involves multiple non-trivial sub-tasks such as object placement and scaling, color/lighting harmonization, viewpoint/geometry adjustment, and shadow/reflection generation. Recent gene…

Object

GALA: Toward Geometry-and-Lighting-Aware Object Search for Compositing

2022-03-31 · Sijie Zhu, Zhe Lin, Scott Cohen, Jason Kuen 외

Compositing-aware object search aims to find the most compatible objects for compositing given a background image and a query bounding box. Previous works focus on learning compatibility between the foreground object and…

Object

Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing

2026-05-31 · Sukhun Ko, Soo Ye Kim, Jihyong Oh arxiv

Image compositing aims to seamlessly insert a foreground object into a background image, and recent advances in diffusion models have significantly enhanced the quality, especially when the foreground and background imag…

Contrastive Learning