paper-with-me

홈 › Papers

Appearance Editing with Free-viewpoint Neural Rendering

2021-10-14 · Pulkit Gera, Aakash KT, Dhawal Sirikonda, Parikshit Sakurikar, P. J. Narayanan

We present a neural rendering framework for simultaneous view synthesis and appearance editing of a scene from multi-view images captured under known environment illumination. Existing approaches either achieve view synthesis alone or view synthesis along with relighting, without direct control over the scene's appearance. Our approach explicitly disentangles the appearance and learns a lighting representation that is independent of it. Specifically, we independently estimate the BRDF and use it to learn a lighting-only representation of the scene. Such disentanglement allows our approach to generalize to arbitrary changes in appearance while performing view synthesis. We show results of editing the appearance of a real scene, demonstrating that our approach produces plausible appearance editing. The performance of our view synthesis approach is demonstrated to be at par with state-of-the-art approaches on both real and synthetic data.

📄 PDF Abstract BibTeX arXiv:2110.07674

Code (1)

darthgera123/Appearance-Editing 공식 구현 pytorch

Tasks

DisentanglementNeural Rendering

Similar Papers 제목 키워드 기반

Neural Sparse Voxel Fields

2020-07-22 · NeurIPS 2020 12 · Lingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua 외

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Rece…

NeRF

FreeStyleGAN: Free-view Editable Portrait Rendering with the Camera Manifold

2021-09-20 · Thomas Leimkühler, George Drettakis

Current Generative Adversarial Networks (GANs) produce photorealistic renderings of portrait images. Embedding real images into the latent space of such models enables high-level image editing. While recent methods provi…

3D ReconstructionMixed RealityNovel View Synthesis

PersonNeRF: Personalized Reconstruction from Photo Collections

2023-02-16 · CVPR 2023 1 · Chung-Yi Weng, Pratul P. Srinivasan, Brian Curless, Ira Kemelmacher-Shlizerman

We present PersonNeRF, a method that takes a collection of photos of a subject (e.g. Roger Federer) captured across multiple years with arbitrary body poses and appearances, and enables rendering the subject with arbitra…

Editable Free-viewpoint Video Using a Layered Neural Representation

2021-04-30 · Jiakai Zhang, Xinhang Liu, Xinyi Ye, Fuqiang Zhao 외

Generating free-viewpoint videos is critical for immersive VR/AR experience but recent neural advances still lack the editing ability to manipulate the visual perception for large dynamic scenes. To fill this gap, in thi…

DisentanglementNeRFScene ParsingVideo Generation

HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video

2022-01-11 · CVPR 2022 1 · Chung-Yi Weng, Brian Curless, Pratul P. Srinivasan, Jonathan T. Barron 외

We introduce a free-viewpoint rendering method -- HumanNeRF -- that works on a given monocular video of a human performing complex body motions, e.g. a video from YouTube. Our method enables pausing the video at any fram…