paper-with-me

홈 › Papers

DirectL: Efficient Radiance Fields Rendering for 3D Light Field Displays

2024-07-19 · Zongyuan Yang, Baolin Liu, Yingde Song, Yongping Xiong, Lan Yi, Zhaohe Zhang, Xunbo Yu

Autostereoscopic display, despite decades of development, has not achieved extensive application, primarily due to the daunting challenge of 3D content creation for non-specialists. The emergence of Radiance Field as an innovative 3D representation has markedly revolutionized the domains of 3D reconstruction and generation. This technology greatly simplifies 3D content creation for common users, broadening the applicability of Light Field Displays (LFDs). However, the combination of these two fields remains largely unexplored. The standard paradigm to create optimal content for parallax-based light field displays demands rendering at least 45 slightly shifted views preferably at high resolution per frame, a substantial hurdle for real-time rendering. We introduce DirectL, a novel rendering paradigm for Radiance Fields on 3D displays. We thoroughly analyze the interweaved mapping of spatial rays to screen subpixels, precisely determine the light rays entering the human eye, and propose subpixel repurposing to significantly reduce the pixel count required for rendering. Tailored for the two predominant radiance fields--Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS), we propose corresponding optimized rendering pipelines that directly render the light field images instead of multi-view images. Extensive experiments across various displays and user study demonstrate that DirectL accelerates rendering by up to 40 times compared to the standard paradigm without sacrificing visual quality. Its rendering process-only modification allows seamless integration into subsequent radiance field tasks. Finally, we integrate DirectL into diverse applications, showcasing the stunning visual experiences and the synergy between LFDs and Radiance Fields, which unveils tremendous potential for commercialization applications. \href{direct-l.github.io}{\textbf{Project Homepage}

📄 PDF Abstract BibTeX arXiv:2407.14053

Code (0)

등록된 구현이 없습니다.

Tasks

3DGS3D Reconstruction

Similar Papers 제목 키워드 기반

Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fields

2024-03-24 · CVPR 2024 1 · Haoyuan Wang, WenBo Hu, Lei Zhu, Rynson W. H. Lau

Inverse rendering aims at recovering both geometry and materials of objects. It provides a more compatible reconstruction for conventional rendering engines, compared with the neural radiance fields (NeRFs). On the other…

Inverse RenderingNeRFObject

VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams

2023-12-03 · CVPR 2024 1 · Liao Wang, Kaixin Yao, Chengcheng Guo, Zhirui Zhang 외

Neural Radiance Fields (NeRFs) excel in photorealistically rendering static scenes. However, rendering dynamic, long-duration radiance fields on ubiquitous devices remains challenging, due to data storage and computation…

Generative Occupancy Fields for 3D Surface-Aware Image Synthesis

2021-11-01 · NeurIPS 2021 12 · Xudong Xu, Xingang Pan, Dahua Lin, Bo Dai

The advent of generative radiance fields has significantly promoted the development of 3D-aware image synthesis. The cumulative rendering process in radiance fields makes training these generative models much easier sinc…

3D-Aware Image SynthesisImage GenerationObject

Neural radiance fields-based holography [Invited]

2024-03-02 · Minsung Kang, Fan Wang, Kai Kumano, Tomoyoshi Ito 외

This study presents a novel approach for generating holograms based on the neural radiance fields (NeRF) technique. Generating three-dimensional (3D) data is difficult in hologram computation. NeRF is a state-of-the-art …

NeRF

GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fields

2023-06-09 · Barbara Roessle, Norman Müller, Lorenzo Porzi, Samuel Rota Bulò 외

Neural Radiance Fields (NeRF) have shown impressive novel view synthesis results; nonetheless, even thorough recordings yield imperfections in reconstructions, for instance due to poorly observed areas or minor lighting …

3D Scene ReconstructionNeRFNovel View Synthesis