paper-with-me

홈 › Papers

Learning Naturally Aggregated Appearance for Efficient 3D Editing

2023-12-11 · Ka Leong Cheng, Qiuyu Wang, Zifan Shi, Kecheng Zheng, Yinghao Xu, Hao Ouyang, Qifeng Chen, Yujun Shen

Neural radiance fields, which represent a 3D scene as a color field and a density field, have demonstrated great progress in novel view synthesis yet are unfavorable for editing due to the implicitness. In view of such a deficiency, we propose to replace the color field with an explicit 2D appearance aggregation, also called canonical image, with which users can easily customize their 3D editing via 2D image processing. To avoid the distortion effect and facilitate convenient editing, we complement the canonical image with a projection field that maps 3D points onto 2D pixels for texture lookup. This field is carefully initialized with a pseudo canonical camera model and optimized with offset regularity to ensure naturalness of the aggregated appearance. Extensive experimental results on three datasets suggest that our representation, dubbed AGAP, well supports various ways of 3D editing (e.g., stylization, interactive drawing, and content extraction) with no need of re-optimization for each case, demonstrating its generalizability and efficiency. Project page is available at https://felixcheng97.github.io/AGAP/.

📄 PDF Abstract BibTeX arXiv:2312.06657

Code (1)

felixcheng97/agap 공식 구현 pytorch

Tasks

Novel View Synthesis

Similar Papers 제목 키워드 기반

VideoSPatS: Video SPatiotemporal Splines for Disentangled Occlusion, Appearance and Motion Modeling and Editing

2025-04-08 · CVPR 2025 1 · Juan Luis Gonzalez Bello, Xu Yao, Alex Whelan, Kyle Olszewski 외

We present an implicit video representation for occlusions, appearance, and motion disentanglement from monocular videos, which we call Video SPatiotemporal Splines (VideoSPatS). Unlike previous methods that map time and…

DisentanglementMotion DisentanglementVideo Editing

EditaLive! Unified Character Video Editing for Live Streaming

2026-08-27 · Zhiyuan Li, Chi-Man Pun, Peng-Tao Jiang, Bo Li 외 arxiv

Conventional video editing primarily focuses on scene-level content, whereas live streaming places greater emphasis on the human subject. However, directly applying existing video-editing methods to human-centric live st…

Video Reconstruction

GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing

2024-03-13 · Jing Wu, Jia-Wang Bian, Xinghui Li, Guangrun Wang 외

We propose GaussCtrl, a text-driven method to edit a 3D scene reconstructed by the 3D Gaussian Splatting (3DGS). Our method first renders a collection of images by using the 3DGS and edits them by using a pre-trained 2D …

3DGS

Edit3DGS: Unified Framework for Dynamic Head Editing via 2D Instruction-Guided Diffusion and 3D Gaussian Splatting

2026-06-16 · Duy-Dat Tran, Trung-Nghia Le arxiv

We present Edit3DGS, a unified framework for dynamic 3D head editing that integrates 2D instruction-guided diffusion with 3D Gaussian splatting. Unlike prior approaches that separately address frame-based edits or static…

3D Reconstruction

MagicProp: Diffusion-based Video Editing via Motion-aware Appearance Propagation

2023-09-02 · Hanshu Yan, Jun Hao Liew, Long Mai, Shanchuan Lin 외

This paper addresses the issue of modifying the visual appearance of videos while preserving their motion. A novel framework, named MagicProp, is proposed, which disentangles the video editing process into two stages: ap…

Video Editing