paper-with-me

Papers

Hyb-NeRF: A Multiresolution Hybrid Encoding for Neural Radiance Fields

2023-11-21 · Yifan Wang, Yi Gong, Yuan Zeng

Recent advances in Neural radiance fields (NeRF) have enabled high-fidelity scene reconstruction for novel view synthesis. However, NeRF requires hundreds of network evaluations per pixel to approximate a volume rendering integral, making it slow to train. Caching NeRFs into explicit data structures can effectively enhance rendering speed but at the cost of higher memory usage. To address these issues, we present Hyb-NeRF, a novel neural radiance field with a multi-resolution hybrid encoding that achieves efficient neural modeling and fast rendering, which also allows for high-quality novel view synthesis. The key idea of Hyb-NeRF is to represent the scene using different encoding strategies from coarse-to-fine resolution levels. Hyb-NeRF exploits memory-efficiency learnable positional features at coarse resolutions and the fast optimization speed and local details of hash-based feature grids at fine resolutions. In addition, to further boost performance, we embed cone tracing-based features in our learnable positional encoding that eliminates encoding ambiguity and reduces aliasing artifacts. Extensive experiments on both synthetic and real-world datasets show that Hyb-NeRF achieves faster rendering speed with better rending quality and even a lower memory footprint in comparison to previous state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2311.12490

Code (0)

등록된 구현이 없습니다.

Tasks

NeRFNovel View Synthesis

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Motion-Oriented Compositional Neural Radiance Fields for Monocular Dynamic Human Modeling

2024-07-16 · Jaehyeok Kim, Dongyoon Wee, Dan Xu

This paper introduces Motion-oriented Compositional Neural Radiance Fields (MoCo-NeRF), a framework designed to perform free-viewpoint rendering of monocular human videos via novel non-rigid motion modeling approach. In …

NeRF

VIRUS-NeRF -- Vision, InfraRed and UltraSonic based Neural Radiance Fields

2024-03-14 · Nicolaj Schmid, Cornelius von Einem, Cesar Cadena, Roland Siegwart 외

Autonomous mobile robots are an increasingly integral part of modern factory and warehouse operations. Obstacle detection, avoidance and path planning are critical safety-relevant tasks, which are often solved using expe…

NeRF

Binary Radiance Fields

2023-06-13 · NeurIPS 2023 11 · Seungjoo Shin, Jaesik Park

In this paper, we propose \textit{binary radiance fields} (BiRF), a storage-efficient radiance field representation employing binary feature encoding that encodes local features using binary encoding parameters in a form…

BinarizationNeRF

Grid-guided Neural Radiance Fields for Large Urban Scenes

2023-03-24 · CVPR 2023 1 · Linning Xu, Yuanbo Xiangli, Sida Peng, Xingang Pan 외

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide …

NeRF

AE-NeRF: Auto-Encoding Neural Radiance Fields for 3D-Aware Object Manipulation

2022-04-28 · Mira Kim, Jaehoon Ko, Kyusun Cho, Junmyeong Choi 외

We propose a novel framework for 3D-aware object manipulation, called Auto-Encoding Neural Radiance Fields (AE-NeRF). Our model, which is formulated in an auto-encoder architecture, extracts disentangled 3D attributes su…

AttributeDisentanglementNeRF