paper-with-me

홈 › Papers

Temporal Interpolation Is All You Need for Dynamic Neural Radiance Fields

2023-02-18 · CVPR 2023 1 · Sungheon Park, Minjung Son, Seokhwan Jang, Young Chun Ahn, Ji-Yeon Kim, Nahyup Kang

Temporal interpolation often plays a crucial role to learn meaningful representations in dynamic scenes. In this paper, we propose a novel method to train spatiotemporal neural radiance fields of dynamic scenes based on temporal interpolation of feature vectors. Two feature interpolation methods are suggested depending on underlying representations, neural networks or grids. In the neural representation, we extract features from space-time inputs via multiple neural network modules and interpolate them based on time frames. The proposed multi-level feature interpolation network effectively captures features of both short-term and long-term time ranges. In the grid representation, space-time features are learned via four-dimensional hash grids, which remarkably reduces training time. The grid representation shows more than 100 times faster training speed than the previous neural-net-based methods while maintaining the rendering quality. Concatenating static and dynamic features and adding a simple smoothness term further improve the performance of our proposed models. Despite the simplicity of the model architectures, our method achieved state-of-the-art performance both in rendering quality for the neural representation and in training speed for the grid representation.

📄 PDF Abstract BibTeX arXiv:2302.09311

Code (0)

등록된 구현이 없습니다.

Tasks

All

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Fast Dynamic Radiance Fields with Time-Aware Neural Voxels

2022-05-30 · Jiemin Fang, Taoran Yi, Xinggang Wang, Lingxi Xie 외

Neural radiance fields (NeRF) have shown great success in modeling 3D scenes and synthesizing novel-view images. However, most previous NeRF methods take much time to optimize one single scene. Explicit data structures, …

NeRF

Consistent4D: Consistent 360° Dynamic Object Generation from Monocular Video

2023-11-06 · Yanqin Jiang, Li Zhang, Jin Gao, Weimin Hu 외

In this paper, we present Consistent4D, a novel approach for generating 4D dynamic objects from uncalibrated monocular videos. Uniquely, we cast the 360-degree dynamic object reconstruction as a 4D generation problem, el…

3D GenerationCamera CalibrationObjectObject Reconstruction+1

Point-DynRF: Point-based Dynamic Radiance Fields from a Monocular Video

2023-10-14 · Byeongjun Park, Changick Kim

Dynamic radiance fields have emerged as a promising approach for generating novel views from a monocular video. However, previous methods enforce the geometric consistency to dynamic radiance fields only between adjacent…

HyperFLINT: Hypernetwork-based Flow Estimation and Temporal Interpolation for Scientific Ensemble Visualization

2024-12-05 · Hamid Gadirov, Qi Wu, David Bauer, Kwan-Liu Ma 외

We present HyperFLINT (Hypernetwork-based FLow estimation and temporal INTerpolation), a novel deep learning-based approach for estimating flow fields, temporally interpolating scalar fields, and facilitating parameter s…

RehearsalNeRF: Decoupling Intrinsic Neural Fields of Dynamic Illuminations for Scene Editing

2026-03-30 · Changyeon Won, Hyunjun Jung, Jungu Cho, Seonmi Park 외 arxiv

Although there has been significant progress in neural radiance fields, an issue on dynamic illumination changes still remains unsolved. Different from relevant works that parameterize time-variant/-invariant components …

Novel View Synthesis