paper-with-me

홈 › Papers

BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing

2025-06-20 · Jiacheng Chen, Ramin Mehran, Xuhui Jia, Saining Xie, Sanghyun Woo

We present BlenderFusion, a generative visual compositing framework that synthesizes new scenes by recomposing objects, camera, and background. It follows a layering-editing-compositing pipeline: (i) segmenting and converting visual inputs into editable 3D entities (layering), (ii) editing them in Blender with 3D-grounded control (editing), and (iii) fusing them into a coherent scene using a generative compositor (compositing). Our generative compositor extends a pre-trained diffusion model to process both the original (source) and edited (target) scenes in parallel. It is fine-tuned on video frames with two key training strategies: (i) source masking, enabling flexible modifications like background replacement; (ii) simulated object jittering, facilitating disentangled control over objects and camera. BlenderFusion significantly outperforms prior methods in complex compositional scene editing tasks.

📄 PDF Abstract BibTeX arXiv:2506.17450

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…

Similar Papers 제목 키워드 기반

IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation

2024-03-15 · CVPR 2024 1 · Yizhi Song, Zhifei Zhang, Zhe Lin, Scott Cohen 외

Generative object compositing emerges as a promising new avenue for compositional image editing. However, the requirement of object identity preservation poses a significant challenge, limiting practical usage of most ex…

Object

Deep Image Compositing

2021-03-29 · Shivangi Aneja, Soham Mazumder

In image editing, the most common task is pasting objects from one image to the other and then eventually adjusting the manifestation of the foreground object with the background object. This task is called image composi…

Benchmarking

Toward Realistic Image Compositing With Adversarial Learning

2019-06-01 · CVPR 2019 6 · Bor-Chun Chen, Andrew Kae

Compositing a realistic image is a challenging task and usually requires considerable human supervision using professional image editing software. In this work we propose a generative adversarial network (GAN) architectu…

Generative Adversarial Network

GenCompositor: Generative Video Compositing with Diffusion Transformer

2025-09-02 · Shuzhou Yang, Xiaoyu Li, Xiaodong Cun, Guangzhi Wang 외 arxiv

Video compositing combines live-action footage to create video production, serving as a crucial technique in video creation and film production. Traditional pipelines require intensive labor efforts and expert collaborat…

Instance Segmentation based Semantic Matting for Compositing Applications

2019-04-10 · Guanqing Hu, James J. Clark

Image compositing is a key step in film making and image editing that aims to segment a foreground object and combine it with a new background. Automatic image compositing can be done easily in a studio using chroma-keyi…

Image MattingInstance SegmentationSemantic Image MattingSemantic Segmentation