paper-with-me

Papers

Efficient Dynamic-NeRF Based Volumetric Video Coding with Rate Distortion Optimization

2024-02-02 · ZhiYu Zhang, Guo Lu, Huanxiong Liang, Anni Tang, Qiang Hu, Li Song

Volumetric videos, benefiting from immersive 3D realism and interactivity, hold vast potential for various applications, while the tremendous data volume poses significant challenges for compression. Recently, NeRF has demonstrated remarkable potential in volumetric video compression thanks to its simple representation and powerful 3D modeling capabilities, where a notable work is ReRF. However, ReRF separates the modeling from compression process, resulting in suboptimal compression efficiency. In contrast, in this paper, we propose a volumetric video compression method based on dynamic NeRF in a more compact manner. Specifically, we decompose the NeRF representation into the coefficient fields and the basis fields, incrementally updating the basis fields in the temporal domain to achieve dynamic modeling. Additionally, we perform end-to-end joint optimization on the modeling and compression process to further improve the compression efficiency. Extensive experiments demonstrate that our method achieves higher compression efficiency compared to ReRF on various datasets.

📄 PDF Abstract BibTeX arXiv:2402.01380

Code (0)

등록된 구현이 없습니다.

Tasks

NeRFVideo Compression

Similar Papers 제목 키워드 기반

Rate-aware Compression for NeRF-based Volumetric Video

2024-11-08 · ZhiYu Zhang, Guo Lu, Huanxiong Liang, Zhengxue Cheng 외

The neural radiance fields (NeRF) have advanced the development of 3D volumetric video technology, but the large data volumes they involve pose significant challenges for storage and transmission. To address these proble…

NeRFQuantization

HPC: Hierarchical Progressive Coding Framework for Volumetric Video

2024-07-12 · Zihan Zheng, Houqiang Zhong, Qiang Hu, Xiaoyun Zhang 외

Volumetric video based on Neural Radiance Field (NeRF) holds vast potential for various 3D applications, but its substantial data volume poses significant challenges for compression and transmission. Current NeRF compres…

NeRF

JointRF: End-to-End Joint Optimization for Dynamic Neural Radiance Field Representation and Compression

2024-05-23 · Zihan Zheng, Houqiang Zhong, Qiang Hu, Xiaoyun Zhang 외

Neural Radiance Field (NeRF) excels in photo-realistically static scenes, inspiring numerous efforts to facilitate volumetric videos. However, rendering dynamic and long-sequence radiance fields remains challenging due t…

Feature CompressionNeRF

FLAME-in-NeRF: Neural control of Radiance Fields for Free View Face Animation

2021-09-29 · ShahRukh Athar, Zhixin Shu, Dimitris Samaras

This paper presents a neural rendering method for controllable portrait video synthesis.Recent advances in volumetric neural rendering, such as neural radiance fields (NeRF), have enabled the photorealistic novel view sy…

NeRFNeural RenderingNovel View Synthesis

FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animation

2021-08-10 · ShahRukh Athar, Zhixin Shu, Dimitris Samaras

This paper presents a neural rendering method for controllable portrait video synthesis. Recent advances in volumetric neural rendering, such as neural radiance fields (NeRF), has enabled the photorealistic novel view sy…

Face ModelNeRFNeural RenderingNovel View Synthesis