paper-with-me

Papers

Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian Splatting

2024-10-28 · Jiawei Xu, Zexin Fan, Jian Yang, Jin Xie

Recently, Gaussian splatting has received more and more attention in the field of static scene rendering. Due to the low computational overhead and inherent flexibility of explicit representations, plane-based explicit methods are popular ways to predict deformations for Gaussian-based dynamic scene rendering models. However, plane-based methods rely on the inappropriate low-rank assumption and excessively decompose the space-time 4D encoding, resulting in overmuch feature overlap and unsatisfactory rendering quality. To tackle these problems, we propose Grid4D, a dynamic scene rendering model based on Gaussian splatting and employing a novel explicit encoding method for the 4D input through the hash encoding. Different from plane-based explicit representations, we decompose the 4D encoding into one spatial and three temporal 3D hash encodings without the low-rank assumption. Additionally, we design a novel attention module that generates the attention scores in a directional range to aggregate the spatial and temporal features. The directional attention enables Grid4D to more accurately fit the diverse deformations across distinct scene components based on the spatial encoded features. Moreover, to mitigate the inherent lack of smoothness in explicit representation methods, we introduce a smooth regularization term that keeps our model from the chaos of deformation prediction. Our experiments demonstrate that Grid4D significantly outperforms the state-of-the-art models in visual quality and rendering speed.

📄 PDF Abstract BibTeX arXiv:2410.20815

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Compressive Imaging Reconstruction via Tensor Decomposed Multi-Resolution Grid Encoding

2025-07-10 · Zhenyu Jin, Yisi Luo, Xile Zhao, Deyu Meng arxiv

Compressive imaging (CI) reconstruction, such as snapshot compressive imaging (SCI) and compressive sensing magnetic resonance imaging (MRI), aims to recover high-dimensional images from low-dimensional compressed measur…

Compressive SensingMRI Reconstruction

Audio-Driven Talking Face Generation with Blink Embedding and Hash Grid Landmarks Encoding

2026-01-26 · Yuhui Zhang, Hui Yu, Wei Liang, Sunjie Zhang arxiv

Dynamic Neural Radiance Fields (NeRF) have demonstrated considerable success in generating high-fidelity 3D models of talking portraits. Despite significant advancements in the rendering speed and generation quality, cha…

Talking Face Generation

Factorized Multi-Resolution HashGrid for Efficient Neural Radiance Fields: Execution on Edge-Devices

2026-04-03 · Kim Jun-Seong, Mingyu Kim, GeonU Kim, Tae-Hyun Oh 외 arxiv

We introduce Fact-Hash, a novel parameter-encoding method for training on-device neural radiance fields. Neural Radiance Fields (NeRF) have proven pivotal in 3D representations, but their applications are limited due to …

Computational Efficiency

Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decomposition

2022-11-22 · Jiaxiang Tang, Kaisiyuan Wang, Hang Zhou, Xiaokang Chen 외

While dynamic Neural Radiance Fields (NeRF) have shown success in high-fidelity 3D modeling of talking portraits, the slow training and inference speed severely obstruct their potential usage. In this paper, we propose a…

NeRFTalking Face Generation

Affine-Equivariant Kernel Space Encoding for NeRF Editing

2025-08-04 · Mikołaj Zieliński, Krzysztof Byrski, Tomasz Szczepanik, Dominik Belter 외 arxiv

Neural scene representations achieve high-fidelity rendering by encoding 3D scenes as continuous functions, but their latent spaces are typically implicit and globally entangled, making localized editing and physically g…