paper-with-me

Papers

WavePlanes: Compact Hex Planes for Dynamic Novel View Synthesis

2023-12-03 · Adrian Azzarelli, Nantheera Anantrasirichai, David R Bull

Dynamic Novel View Synthesis (Dynamic NVS) enhances NVS technologies to model moving 3-D scenes. However, current methods are resource intensive and challenging to compress. To address this, we present WavePlanes, a fast and more compact hex plane representation, applicable to both Neural Radiance Fields and Gaussian Splatting methods. Rather than modeling many feature scales separately (as done previously), we use the inverse discrete wavelet transform to reconstruct features at varying scales. This leads to a more compact representation and allows us to explore wavelet-based compression schemes for further gains. The proposed compression scheme exploits the sparsity of wavelet coefficients, by applying hard thresholding to the wavelet planes and storing nonzero coefficients and their locations on each plane in a Hash Map. Compared to the state-of-the-art (SotA), WavePlanes is significantly smaller, less resource demanding and competitive in reconstruction quality. Compared to small SotA models, WavePlanes outperforms methods in both model size and quality of novel views.

📄 PDF Abstract BibTeX arXiv:2312.02218

Code (1)

azzarelli/waveplanes 공식 구현 pytorch

Tasks

Novel View Synthesis

Similar Papers 제목 키워드 기반

LiveView: Dynamic Target-Centered MPI for View Synthesis

2021-07-11 · Sushobhan Ghosh, Zhaoyang Lv, Nathan Matsuda, Lei Xiao 외

Existing Multi-Plane Image (MPI) based view-synthesis methods generate an MPI aligned with the input view using a fixed number of planes in one forward pass. These methods produce fast, high-quality rendering of novel vi…

Novel View Synthesis

Self-improving Multiplane-to-layer Images for Novel View Synthesis

2022-10-04 · Pavel Solovev, Taras Khakhulin, Denis Korzhenkov

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-exp…

Generalizable Novel View SynthesisNovel View Synthesis

SurMo: Surface-based 4D Motion Modeling for Dynamic Human Rendering

2024-04-01 · CVPR 2024 1 · Tao Hu, Fangzhou Hong, Ziwei Liu

Dynamic human rendering from video sequences has achieved remarkable progress by formulating the rendering as a mapping from static poses to human images. However, existing methods focus on the human appearance reconstru…

Generalizable Novel View SynthesisNovel View Synthesis

Audio-Plane: Audio Factorization Plane Gaussian Splatting for Real-Time Talking Head Synthesis

2025-03-28 · Shuai Shen, Wanhua Li, Yunpeng Zhang, Weipeng Hu 외

Talking head synthesis has become a key research area in computer graphics and multimedia, yet most existing methods often struggle to balance generation quality with computational efficiency. In this paper, we present a…

Computational EfficiencyTalking Head Generation

Neural 3D Video Synthesis from Multi-view Video

2021-03-03 · CVPR 2022 1 · Tianye Li, Mira Slavcheva, Michael Zollhoefer, Simon Green 외

We propose a novel approach for 3D video synthesis that is able to represent multi-view video recordings of a dynamic real-world scene in a compact, yet expressive representation that enables high-quality view synthesis …

Motion Interpolation