paper-with-me

Papers

TriNeRFLet: A Wavelet Based Triplane NeRF Representation

2024-01-11 · Rajaei Khatib, Raja Giryes

In recent years, the neural radiance field (NeRF) model has gained popularity due to its ability to recover complex 3D scenes. Following its success, many approaches proposed different NeRF representations in order to further improve both runtime and performance. One such example is Triplane, in which NeRF is represented using three 2D feature planes. This enables easily using existing 2D neural networks in this framework, e.g., to generate the three planes. Despite its advantage, the triplane representation lagged behind in its 3D recovery quality compared to NeRF solutions. In this work, we propose TriNeRFLet, a 2D wavelet-based multiscale triplane representation for NeRF, which closes the 3D recovery performance gap and is competitive with current state-of-the-art methods. Building upon the triplane framework, we also propose a novel super-resolution (SR) technique that combines a diffusion model with TriNeRFLet for improving NeRF resolution.

📄 PDF Abstract BibTeX arXiv:2401.06191

Code (0)

등록된 구현이 없습니다.

Tasks

NeRFSuper-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DT-NeRF: Decomposed Triplane-Hash Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis

2023-09-14 · Yaoyu Su, Shaohui Wang, Haoqian Wang

In this paper, we present the decomposed triplane-hash neural radiance fields (DT-NeRF), a framework that significantly improves the photorealistic rendering of talking faces and achieves state-of-the-art results on key …

NeRF

Disentangled Generation and Aggregation for Robust Radiance Fields

2024-09-24 · Shihe Shen, Huachen Gao, Wangze Xu, Rui Peng 외

The utilization of the triplane-based radiance fields has gained attention in recent years due to its ability to effectively disentangle 3D scenes with a high-quality representation and low computation cost. A key requir…

NeRFNovel View Synthesis

GTR: Improving Large 3D Reconstruction Models through Geometry and Texture Refinement

2024-06-09 · Peiye Zhuang, Songfang Han, Chaoyang Wang, Aliaksandr Siarohin 외

We propose a novel approach for 3D mesh reconstruction from multi-view images. Our method takes inspiration from large reconstruction models like LRM that use a transformer-based triplane generator and a Neural Radiance …

3D Generation3D ReconstructionImage to 3DNeRF

Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM

2024-01-22 · Zhenzhen Weng, Jingyuan Liu, Hao Tan, Zhan Xu 외

Reconstructing 3D humans from a single image has been extensively investigated. However, existing approaches often fall short on capturing fine geometry and appearance details, hallucinating occluded parts with plausible…

DecoderNeRF

WaveNeRF: Wavelet-based Generalizable Neural Radiance Fields

2023-08-09 · ICCV 2023 1 · Muyu Xu, Fangneng Zhan, Jiahui Zhang, Yingchen Yu 외

Neural Radiance Field (NeRF) has shown impressive performance in novel view synthesis via implicit scene representation. However, it usually suffers from poor scalability as requiring densely sampled images for each new …

NeRFNovel View Synthesis