paper-with-me

Papers

JointRF: End-to-End Joint Optimization for Dynamic Neural Radiance Field Representation and Compression

2024-05-23 · Zihan Zheng, Houqiang Zhong, Qiang Hu, Xiaoyun Zhang, Li Song, Ya zhang, Yanfeng Wang

Neural Radiance Field (NeRF) excels in photo-realistically static scenes, inspiring numerous efforts to facilitate volumetric videos. However, rendering dynamic and long-sequence radiance fields remains challenging due to the significant data required to represent volumetric videos. In this paper, we propose a novel end-to-end joint optimization scheme of dynamic NeRF representation and compression, called JointRF, thus achieving significantly improved quality and compression efficiency against the previous methods. Specifically, JointRF employs a compact residual feature grid and a coefficient feature grid to represent the dynamic NeRF. This representation handles large motions without compromising quality while concurrently diminishing temporal redundancy. We also introduce a sequential feature compression subnetwork to further reduce spatial-temporal redundancy. Finally, the representation and compression subnetworks are end-to-end trained combined within the JointRF. Extensive experiments demonstrate that JointRF can achieve superior compression performance across various datasets.

📄 PDF Abstract BibTeX arXiv:2405.14452

Code (0)

등록된 구현이 없습니다.

Tasks

Feature CompressionNeRF

Similar Papers 제목 키워드 기반

Progressively Optimized Local Radiance Fields for Robust View Synthesis

2023-03-24 · CVPR 2023 1 · Andreas Meuleman, Yu-Lun Liu, Chen Gao, Jia-Bin Huang 외

We present an algorithm for reconstructing the radiance field of a large-scale scene from a single casually captured video. The task poses two core challenges. First, most existing radiance field reconstruction approache…

ExBluRF: Efficient Radiance Fields for Extreme Motion Blurred Images

2023-09-16 · ICCV 2023 1 · Dongwoo Lee, Jeongtaek Oh, Jaesung Rim, Sunghyun Cho 외

We present ExBluRF, a novel view synthesis method for extreme motion blurred images based on efficient radiance fields optimization. Our approach consists of two main components: 6-DOF camera trajectory-based motion blur…

GPUNovel View Synthesis

SiNeRF: Sinusoidal Neural Radiance Fields for Joint Pose Estimation and Scene Reconstruction

2022-10-10 · Yitong Xia, Hao Tang, Radu Timofte, Luc van Gool

NeRFmm is the Neural Radiance Fields (NeRF) that deal with Joint Optimization tasks, i.e., reconstructing real-world scenes and registering camera parameters simultaneously. Despite NeRFmm producing precise scene synthes…

Image GenerationNeRFPose Estimation

EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points

2022-12-07 · CVPR 2023 1 · Chengwei Zheng, Wenbin Lin, Feng Xu

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neura…

NeRFNovel View Synthesis

DGD: Dynamic 3D Gaussians Distillation

2024-05-29 · Isaac Labe, Noam Issachar, Itai Lang, Sagie Benaim

We tackle the task of learning dynamic 3D semantic radiance fields given a single monocular video as input. Our learned semantic radiance field captures per-point semantics as well as color and geometric properties for a…

3D Object TrackingObject Tracking