paper-with-me

홈 › Papers

NeRF synthesis with shading guidance

2023-06-20 · Chenbin Li, Yu Xin, Gaoyi Liu, Xiang Zeng, Ligang Liu

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes requires images from different viewpoints, which limits its practical application. This problem can be even more pronounced for large scenes. In this paper, we introduce a new task called NeRF synthesis that utilizes the structural content of a NeRF patch exemplar to construct a new radiance field of large size. We propose a two-phase method for synthesizing new scenes that are continuous in geometry and appearance. We also propose a boundary constraint method to synthesize scenes of arbitrary size without artifacts. Specifically, we control the lighting effects of synthesized scenes using shading guidance instead of decoupling the scene. We have demonstrated that our method can generate high-quality results with consistent geometry and appearance, even for scenes with complex lighting. We can also synthesize new scenes on curved surface with arbitrary lighting effects, which enhances the practicality of our proposed NeRF synthesis approach.

📄 PDF Abstract BibTeX arXiv:2306.11556

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Similar Papers 제목 키워드 기반

Beyond RGB: Scene-Property Synthesis with Neural Radiance Fields

2022-06-09 · Mingtong Zhang, Shuhong Zheng, Zhipeng Bao, Martial Hebert 외

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative…

Data AugmentationEdge DetectionKeypoint DetectionNeRF+4

S$^3$-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpoint

2022-10-17 · Wenqi Yang, GuanYing Chen, Chaofeng Chen, Zhenfang Chen 외

In this paper, we address the "dual problem" of multi-view scene reconstruction in which we utilize single-view images captured under different point lights to learn a neural scene representation. Different from existing…

3D geometryNeRFNovel View Synthesis

Intrinsic PAPR for Point-level 3D Scene Albedo and Shading Editing

2024-06-29 · Alireza Moazeni, Shichong Peng, Ke Li

Recent advancements in neural rendering have excelled at novel view synthesis from multi-view RGB images. However, they often lack the capability to edit the shading or colour of the scene at a detailed point-level, whil…

Inverse RenderingNeRFNeural RenderingNovel View Synthesis

InceptionHuman: Controllable Prompt-to-NeRF for Photorealistic 3D Human Generation

2023-11-27 · Shiu-hong Kao, Xinhang Liu, Yu-Wing Tai, Chi-Keung Tang

This paper presents InceptionHuman, a prompt-to-NeRF framework that allows easy control via a combination of prompts in different modalities (e.g., text, poses, edge, segmentation map, etc) as inputs to generate photorea…

Density EstimationNeRF

HG3-NeRF: Hierarchical Geometric, Semantic, and Photometric Guided Neural Radiance Fields for Sparse View Inputs

2024-01-22 · Zelin Gao, Weichen Dai, Yu Zhang

Neural Radiance Fields (NeRF) have garnered considerable attention as a paradigm for novel view synthesis by learning scene representations from discrete observations. Nevertheless, NeRF exhibit pronounced performance de…

NeRFNovel View Synthesis