paper-with-me

홈 › Papers

Compact Real-time Radiance Fields with Neural Codebook

2023-05-29 · Lingzhi Li, Zhongshu Wang, Zhen Shen, Li Shen, Ping Tan

Reconstructing neural radiance fields with explicit volumetric representations, demonstrated by Plenoxels, has shown remarkable advantages on training and rendering efficiency, while grid-based representations typically induce considerable overhead for storage and transmission. In this work, we present a simple and effective framework for pursuing compact radiance fields from the perspective of compression methodology. By exploiting intrinsic properties exhibiting in grid models, a non-uniform compression stem is developed to significantly reduce model complexity and a novel parameterized module, named Neural Codebook, is introduced for better encoding high-frequency details specific to per-scene models via a fast optimization. Our approach can achieve over 40 $\times$ reduction on grid model storage with competitive rendering quality. In addition, the method can achieve real-time rendering speed with 180 fps, realizing significant advantage on storage cost compared to real-time rendering methods.

📄 PDF Abstract BibTeX arXiv:2305.18163

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

NeVRF: Neural Video-based Radiance Fields for Long-duration Sequences

2023-12-10 · Minye Wu, Tinne Tuytelaars

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes …

Continual LearningNeRFNovel View Synthesis

NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshes

2023-03-16 · Marie-Julie Rakotosaona, Fabian Manhardt, Diego Martin Arroyo, Michael Niemeyer 외

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis usin…

NeRFNovel View SynthesisSurface Reconstruction

Pose-Free Neural Radiance Fields via Implicit Pose Regularization

2023-08-29 · ICCV 2023 1 · Jiahui Zhang, Fangneng Zhan, Yingchen Yu, Kunhao Liu 외

Pose-free neural radiance fields (NeRF) aim to train NeRF with unposed multi-view images and it has achieved very impressive success in recent years. Most existing works share the pipeline of training a coarse pose estim…

NeRFNovel View SynthesisPose Estimation

Compact 3D Gaussian Representation for Radiance Field

2023-11-22 · CVPR 2024 1 · Joo Chan Lee, Daniel Rho, Xiangyu Sun, Jong Hwan Ko 외

Neural Radiance Fields (NeRFs) have demonstrated remarkable potential in capturing complex 3D scenes with high fidelity. However, one persistent challenge that hinders the widespread adoption of NeRFs is the computationa…

3DGSModel CompressionNovel View SynthesisQuantization

Neural Residual Radiance Fields for Streamably Free-Viewpoint Videos

2023-04-10 · CVPR 2023 1 · Liao Wang, Qiang Hu, Qihan He, Ziyu Wang 외

The success of the Neural Radiance Fields (NeRFs) for modeling and free-view rendering static objects has inspired numerous attempts on dynamic scenes. Current techniques that utilize neural rendering for facilitating fr…

DecoderNeural Rendering