paper-with-me

홈 › Papers

HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputs

2021-12-06 · CVPR 2022 1 · Fuqiang Zhao, Wei Yang, Jiakai Zhang, Pei Lin, Yingliang Zhang, Jingyi Yu, Lan Xu

Recent neural human representations can produce high-quality multi-view rendering but require using dense multi-view inputs and costly training. They are hence largely limited to static models as training each frame is infeasible. We present HumanNeRF - a generalizable neural representation - for high-fidelity free-view synthesis of dynamic humans. Analogous to how IBRNet assists NeRF by avoiding per-scene training, HumanNeRF employs an aggregated pixel-alignment feature across multi-view inputs along with a pose embedded non-rigid deformation field for tackling dynamic motions. The raw HumanNeRF can already produce reasonable rendering on sparse video inputs of unseen subjects and camera settings. To further improve the rendering quality, we augment our solution with an appearance blending module for combining the benefits of both neural volumetric rendering and neural texture blending. Extensive experiments on various multi-view dynamic human datasets demonstrate the generalizability and effectiveness of our approach in synthesizing photo-realistic free-view humans under challenging motions and with very sparse camera view inputs.

📄 PDF Abstract BibTeX arXiv:2112.02789

Code (0)

등록된 구현이 없습니다.

Tasks

NeRF

Similar Papers 제목 키워드 기반

HumanNeRF-SE: A Simple yet Effective Approach to Animate HumanNeRF with Diverse Poses

2023-12-04 · CVPR 2024 1 · Caoyuan Ma, Yu-Lun Liu, Zhixiang Wang, Wu Liu 외

We present HumanNeRF-SE, a simple yet effective method that synthesizes diverse novel pose images with simple input. Previous HumanNeRF works require a large number of optimizable parameters to fit the human images. Inst…

A Comprehensive Benchmark for Neural Human Radiance Fields

2023-09-26 · NeurIPS 2023 11

The past two years have witnessed a significant increase in interest concerning NeRF-based human body rendering. While this surge has propelled considerable advancements, it has also led to an influx of methods and datas…

HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video

2022-01-11 · CVPR 2022 1 · Chung-Yi Weng, Brian Curless, Pratul P. Srinivasan, Jonathan T. Barron 외

We introduce a free-viewpoint rendering method -- HumanNeRF -- that works on a given monocular video of a human performing complex body motions, e.g. a video from YouTube. Our method enables pausing the video at any fram…

EG-HumanNeRF: Efficient Generalizable Human NeRF Utilizing Human Prior for Sparse View

2024-10-16 · Zhaorong Wang, Yoshihiro Kanamori, Yuki Endo

Generalizable neural radiance field (NeRF) enables neural-based digital human rendering without per-scene retraining. When combined with human prior knowledge, high-quality human rendering can be achieved even with spars…

NeRFNovel View Synthesis

Generative Neural Articulated Radiance Fields

2022-06-28 · Alexander W. Bergman, Petr Kellnhofer, Wang Yifan, Eric R. Chan 외

Unsupervised learning of 3D-aware generative adversarial networks (GANs) using only collections of single-view 2D photographs has very recently made much progress. These 3D GANs, however, have not been demonstrated for h…