paper-with-me

Papers

Generalizable Neural Human Renderer

2024-04-22 · Mana Masuda, Jinhyung Park, Shun Iwase, Rawal Khirodkar, Kris Kitani

While recent advancements in animatable human rendering have achieved remarkable results, they require test-time optimization for each subject which can be a significant limitation for real-world applications. To address this, we tackle the challenging task of learning a Generalizable Neural Human Renderer (GNH), a novel method for rendering animatable humans from monocular video without any test-time optimization. Our core method focuses on transferring appearance information from the input video to the output image plane by utilizing explicit body priors and multi-view geometry. To render the subject in the intended pose, we utilize a straightforward CNN-based image renderer, foregoing the more common ray-sampling or rasterizing-based rendering modules. Our GNH achieves remarkable generalizable, photorealistic rendering with unseen subjects with a three-stage process. We quantitatively and qualitatively demonstrate that GNH significantly surpasses current state-of-the-art methods, notably achieving a 31.3% improvement in LPIPS.

📄 PDF Abstract BibTeX arXiv:2404.14199

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Human-Level 3D Relative Pose Estimation: Generalizable, Training-Free, with Single Reference

2024-06-26 · Yuan Gao, Yajing Luo, Junhong Wang, Kui Jia 외

Humans can easily deduce the relative pose of an unseen object, without label/training, given only a single query-reference image pair. This is arguably achieved by incorporating (i) 3D/2.5D shape perception from a singl…

Pose Estimation

GeoNeRF: Generalizing NeRF with Geometry Priors

2021-11-26 · CVPR 2022 1 · Mohammad Mahdi Johari, Yann Lepoittevin, François Fleuret

We present GeoNeRF, a generalizable photorealistic novel view synthesis method based on neural radiance fields. Our approach consists of two main stages: a geometry reasoner and a renderer. To render a novel view, the ge…

NeRFNeural RenderingNovel View Synthesis

NARVis: Neural Accelerated Rendering for Real-Time Scientific Point Cloud Visualization

2024-07-26 · Srinidhi Hegde, Kaur Kullman, Thomas Grubb, Leslie Lait 외

Exploring scientific datasets with billions of samples in real-time visualization presents a challenge - balancing high-fidelity rendering with speed. This work introduces a novel renderer - Neural Accelerated Renderer (…

GPU

Global Latent Neural Rendering

2023-12-13 · CVPR 2024 1 · Thomas Tanay, Matteo Maggioni

A recent trend among generalizable novel view synthesis methods is to learn a rendering operator acting over single camera rays. This approach is promising because it removes the need for explicit volumetric rendering, b…

Generalizable Novel View SynthesisNeural RenderingNovel View Synthesis

Generalizable Pose Estimation Using Implicit Scene Representations

2023-05-26 · Vaibhav Saxena, Kamal Rahimi Malekshan, Linh Tran, Yotto Koga

6-DoF pose estimation is an essential component of robotic manipulation pipelines. However, it usually suffers from a lack of generalization to new instances and object types. Most widely used methods learn to infer the …

Density EstimationObjectPose Estimation