paper-with-me

Papers

Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering

2021-09-04 · ICCV 2021 10 · Bangbang Yang, yinda zhang, Yinghao Xu, Yijin Li, Han Zhou, Hujun Bao, Guofeng Zhang, Zhaopeng Cui

Implicit neural rendering techniques have shown promising results for novel view synthesis. However, existing methods usually encode the entire scene as a whole, which is generally not aware of the object identity and limits the ability to the high-level editing tasks such as moving or adding furniture. In this paper, we present a novel neural scene rendering system, which learns an object-compositional neural radiance field and produces realistic rendering with editing capability for a clustered and real-world scene. Specifically, we design a novel two-pathway architecture, in which the scene branch encodes the scene geometry and appearance, and the object branch encodes each standalone object conditioned on learnable object activation codes. To survive the training in heavily cluttered scenes, we propose a scene-guided training strategy to solve the 3D space ambiguity in the occluded regions and learn sharp boundaries for each object. Extensive experiments demonstrate that our system not only achieves competitive performance for static scene novel-view synthesis, but also produces realistic rendering for object-level editing.

📄 PDF Abstract BibTeX arXiv:2109.01847

Code (0)

등록된 구현이 없습니다.

Tasks

Neural RenderingNovel View SynthesisObject

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Learning Unified Decompositional and Compositional NeRF for Editable Novel View Synthesis

2023-08-05 · ICCV 2023 1 · Yuxin Wang, Wayne Wu, Dan Xu

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scen…

NeRFNovel View Synthesis

CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout

2023-03-24 · Haotian Bai, Yuanhuiyi Lyu, Lutao Jiang, Sijia Li 외

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generati…

NeRFObjectScene GenerationText to 3D

EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points

2022-12-07 · CVPR 2023 1 · Chengwei Zheng, Wenbin Lin, Feng Xu

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neura…

NeRFNovel View Synthesis

Panoptic Compositional Feature Field for Editable Scene Rendering With Network-Inferred Labels via Metric Learning

2023-01-01 · CVPR 2023 1 · Xinhua Cheng, Yanmin Wu, Mengxi Jia, Qian Wang 외

Despite neural implicit representations demonstrating impressive high-quality view synthesis capacity, decomposing such representations into objects for instance-level editing is still challenging. Recent works learn…

2D Panoptic SegmentationMetric LearningNovel View SynthesisPanoptic Segmentation

Car-Studio: Learning Car Radiance Fields from Single-View and Endless In-the-wild Images

2023-07-26 · Tianyu Liu, Hao Zhao, Yang Yu, Guyue Zhou 외

Compositional neural scene graph studies have shown that radiance fields can be an efficient tool in an editable autonomous driving simulator. However, previous studies learned within a sequence of autonomous driving dat…

Autonomous Driving