paper-with-me

홈 › Papers

HumanNeRF-SE: A Simple yet Effective Approach to Animate HumanNeRF with Diverse Poses

2023-12-04 · CVPR 2024 1 · Caoyuan Ma, Yu-Lun Liu, Zhixiang Wang, Wu Liu, Xinchen Liu, Zheng Wang

We present HumanNeRF-SE, a simple yet effective method that synthesizes diverse novel pose images with simple input. Previous HumanNeRF works require a large number of optimizable parameters to fit the human images. Instead, we reload these approaches by combining explicit and implicit human representations to design both generalized rigid deformation and specific non-rigid deformation. Our key insight is that explicit shape can reduce the sampling points used to fit implicit representation, and frozen blending weights from SMPL constructing a generalized rigid deformation can effectively avoid overfitting and improve pose generalization performance. Our architecture involving both explicit and implicit representation is simple yet effective. Experiments demonstrate our model can synthesize images under arbitrary poses with few-shot input and increase the speed of synthesizing images by 15 times through a reduction in computational complexity without using any existing acceleration modules. Compared to the state-of-the-art HumanNeRF studies, HumanNeRF-SE achieves better performance with fewer learnable parameters and less training time.

📄 PDF Abstract BibTeX arXiv:2312.02232

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputs

2021-12-06 · CVPR 2022 1 · Fuqiang Zhao, Wei Yang, Jiakai Zhang, Pei Lin 외

Recent neural human representations can produce high-quality multi-view rendering but require using dense multi-view inputs and costly training. They are hence largely limited to static models as training each frame is i…

NeRF

HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video

2022-01-11 · CVPR 2022 1 · Chung-Yi Weng, Brian Curless, Pratul P. Srinivasan, Jonathan T. Barron 외

We introduce a free-viewpoint rendering method -- HumanNeRF -- that works on a given monocular video of a human performing complex body motions, e.g. a video from YouTube. Our method enables pausing the video at any fram…

A Comprehensive Benchmark for Neural Human Radiance Fields

2023-09-26 · NeurIPS 2023 11

The past two years have witnessed a significant increase in interest concerning NeRF-based human body rendering. While this surge has propelled considerable advancements, it has also led to an influx of methods and datas…

EG-HumanNeRF: Efficient Generalizable Human NeRF Utilizing Human Prior for Sparse View

2024-10-16 · Zhaorong Wang, Yoshihiro Kanamori, Yuki Endo

Generalizable neural radiance field (NeRF) enables neural-based digital human rendering without per-scene retraining. When combined with human prior knowledge, high-quality human rendering can be achieved even with spars…

NeRFNovel View Synthesis

L4GM: Large 4D Gaussian Reconstruction Model

2024-06-14 · Jiawei Ren, Kevin Xie, Ashkan Mirzaei, Hanxue Liang 외

We present L4GM, the first 4D Large Reconstruction Model that produces animated objects from a single-view video input -- in a single feed-forward pass that takes only a second. Key to our success is a novel dataset of m…

model