paper-with-me

홈 › Papers

K-Planes: Explicit Radiance Fields in Space, Time, and Appearance

2023-01-24 · CVPR 2023 1 · Sara Fridovich-Keil, Giacomo Meanti, Frederik Warburg, Benjamin Recht, Angjoo Kanazawa

We introduce k-planes, a white-box model for radiance fields in arbitrary dimensions. Our model uses d choose 2 planes to represent a d-dimensional scene, providing a seamless way to go from static (d=3) to dynamic (d=4) scenes. This planar factorization makes adding dimension-specific priors easy, e.g. temporal smoothness and multi-resolution spatial structure, and induces a natural decomposition of static and dynamic components of a scene. We use a linear feature decoder with a learned color basis that yields similar performance as a nonlinear black-box MLP decoder. Across a range of synthetic and real, static and dynamic, fixed and varying appearance scenes, k-planes yields competitive and often state-of-the-art reconstruction fidelity with low memory usage, achieving 1000x compression over a full 4D grid, and fast optimization with a pure PyTorch implementation. For video results and code, please see https://sarafridov.github.io/K-Planes.

📄 PDF Abstract BibTeX arXiv:2301.10241

Code (2)

sarafridov/k-planes 공식 구현 pytorch
MaximeVandegar/Papers-in-100-Lines-of-Code/tree/main/KPlanes_Explicit_Radiance_Fields_in_Space_Time_and_Appearance pytorch

Tasks

DecoderNovel View Synthesis

Similar Papers 제목 키워드 기반

Learning Neural Implicit Surfaces with Object-Aware Radiance Fields

2023-01-01 · ICCV 2023 1 · Yiheng Zhang, Zhaofan Qiu, Yingwei Pan, Ting Yao 외

Recent progress on multi-view 3D object reconstruction has featured neural implicit surfaces via learning high-fidelity radiance fields. However, most approaches hinge on the visual hull derived from cost-expensive s…

3D Object ReconstructionObjectObject Reconstruction

MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes

2023-02-23 · Christian Reiser, Richard Szeliski, Dor Verbin, Pratul P. Srinivasan 외

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale …

Neural Processing of Tri-Plane Hybrid Neural Fields

2023-10-02 · Adriano Cardace, Pierluigi Zama Ramirez, Francesco Ballerini, Allan Zhou 외

Driven by the appealing properties of neural fields for storing and communicating 3D data, the problem of directly processing them to address tasks such as classification and part segmentation has emerged and has been in…

Multi-Plane Neural Radiance Fields for Novel View Synthesis

2023-03-03 · Youssef Abdelkareem, Shady Shehata, Fakhri Karray

Novel view synthesis is a long-standing problem that revolves around rendering frames of scenes from novel camera viewpoints. Volumetric approaches provide a solution for modeling occlusions through the explicit 3D repre…

NeRFNovel View Synthesis

MuRF: Multi-Baseline Radiance Fields

2023-12-07 · CVPR 2024 1 · Haofei Xu, Anpei Chen, Yuedong Chen, Christos Sakaridis 외

We present Multi-Baseline Radiance Fields (MuRF), a general feed-forward approach to solving sparse view synthesis under multiple different baseline settings (small and large baselines, and different number of input view…

NeRFZero-shot Generalization