Adjustable Visual Appearance for Generalizable Novel View Synthesis
We present a generalizable novel view synthesis method which enables modifying the visual appearance of an observed scene so rendered views match a target weather or lighting condition without any scene specific training or access to reference views at the target condition. Our method is based on a pretrained generalizable transformer architecture and is fine-tuned on synthetically generated scenes under different appearance conditions. This allows for rendering novel views in a consistent manner for 3D scenes that were not included in the training set, along with the ability to (i) modify their appearance to match the target condition and (ii) smoothly interpolate between different conditions. Experiments on real and synthetic scenes show that our method is able to generate 3D consistent renderings while making realistic appearance changes, including qualitative and quantitative comparisons. Please refer to our project page for video results: https://ava-nvs.github.io/
Code (0)
등록된 구현이 없습니다.
Tasks
Generalizable Novel View SynthesisNovel View SynthesisStyle TransferSimilar Papers 제목 키워드 기반
iVS-Net: Learning Human View Synthesis from Internet Videos
Recent advances in implicit neural representations make it possible to generate free-viewpoint videos of the human from sparse view images. To avoid the expensive training for each person, previous methods adopt the …
Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis
This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as inputs and skirting per-case fine-tuning. …
Novel View SynthesisG3Splat: Geometrically Consistent Generalizable Gaussian Splatting
3D Gaussians have become a powerful scene representation for real-time splatting and high-quality novel-view synthesis. This has motivated generalizable splatting -- methods that adapt feed-forward geometry prediction ne…
Pose EstimationPhysically Inspired Gaussian Splatting for HDR Novel View Synthesis
High dynamic range novel view synthesis (HDR-NVS) reconstructs scenes with dynamic details by fusing multi-exposure low dynamic range (LDR) views, yet it struggles to capture ambient illumination-dependent appearance. Im…
Novel View SynthesisGM-NeRF: Learning Generalizable Model-based Neural Radiance Fields from Multi-view Images
In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body p…
NeRFNeural RenderingNovel View Synthesis