paper-with-me

홈 › Papers

Human Synthesis and Scene Compositing

2019-09-23 · Mihai Zanfir, Elisabeta Oneata, Alin-Ionut Popa, Andrei Zanfir, Cristian Sminchisescu

Generating good quality and geometrically plausible synthetic images of humans with the ability to control appearance, pose and shape parameters, has become increasingly important for a variety of tasks ranging from photo editing, fashion virtual try-on, to special effects and image compression. In this paper, we propose HUSC, a HUman Synthesis and Scene Compositing framework for the realistic synthesis of humans with different appearance, in novel poses and scenes. Central to our formulation is 3d reasoning for both people and scenes, in order to produce realistic collages, by correctly modeling perspective effects and occlusion, by taking into account scene semantics and by adequately handling relative scales. Conceptually our framework consists of three components: (1) a human image synthesis model with controllable pose and appearance, based on a parametric representation, (2) a person insertion procedure that leverages the geometry and semantics of the 3d scene, and (3) an appearance compositing process to create a seamless blending between the colors of the scene and the generated human image, and avoid visual artifacts. The performance of our framework is supported by both qualitative and quantitative results, in particular state-of-the art synthesis scores for the DeepFashion dataset.

📄 PDF Abstract BibTeX arXiv:1909.10307

Code (0)

등록된 구현이 없습니다.

Tasks

Image CompressionImage GenerationVirtual Try-on

Similar Papers 제목 키워드 기반

ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusion

2024-10-10 · Zitian Zhang, Frédéric Fortier-Chouinard, Mathieu Garon, Anand Bhattad 외

We present ZeroComp, an effective zero-shot 3D object compositing approach that does not require paired composite-scene images during training. Our method leverages ControlNet to condition from intrinsic images and combi…

BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing

2025-06-20 · Jiacheng Chen, Ramin Mehran, Xuhui Jia, Saining Xie 외

We present BlenderFusion, a generative visual compositing framework that synthesizes new scenes by recomposing objects, camera, and background. It follows a layering-editing-compositing pipeline: (i) segmenting and conve…

Instance Segmentation based Semantic Matting for Compositing Applications

2019-04-10 · Guanqing Hu, James J. Clark

Image compositing is a key step in film making and image editing that aims to segment a foreground object and combine it with a new background. Automatic image compositing can be done easily in a studio using chroma-keyi…

Image MattingInstance SegmentationSemantic Image MattingSemantic Segmentation

FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fields

2023-07-21 · ICCV 2023 1 · Sungwon Hwang, Junha Hyung, Daejin Kim, Min-Jung Kim 외

As recent advances in Neural Radiance Fields (NeRF) have enabled high-fidelity 3D face reconstruction and novel view synthesis, its manipulation also became an essential task in 3D vision. However, existing manipulation …

3D Face ReconstructionAttributeFace ReconstructionNeRF+1

Mimicking the In-Camera Color Pipeline for Camera-Aware Object Compositing

2019-03-27 · Jun Gao, Xiao Li, Li-Wei Wang, Sanja Fidler 외

We present a method for compositing virtual objects into a photograph such that the object colors appear to have been processed by the photo's camera imaging pipeline. Compositing in such a camera-aware manner is essenti…