paper-with-me

홈 › Papers

VR-Pipe: Streamlining Hardware Graphics Pipeline for Volume Rendering

2025-02-24 · Junseo Lee, Jaisung Kim, Junyong Park, Jaewoong Sim

Graphics rendering that builds on machine learning and radiance fields is gaining significant attention due to its outstanding quality and speed in generating photorealistic images from novel viewpoints. However, prior work has primarily focused on evaluating its performance through software-based rendering on programmable shader cores, leaving its performance when exploiting fixed-function graphics units largely unexplored. In this paper, we investigate the performance implications of performing radiance field rendering on the hardware graphics pipeline. In doing so, we implement the state-of-the-art radiance field method, 3D Gaussian splatting, using graphics APIs and evaluate it across synthetic and real-world scenes on today's graphics hardware. Based on our analysis, we present VR-Pipe, which seamlessly integrates two innovations into graphics hardware to streamline the hardware pipeline for volume rendering, such as radiance field methods. First, we introduce native hardware support for early termination by repurposing existing special-purpose hardware in modern GPUs. Second, we propose multi-granular tile binning with quad merging, which opportunistically blends fragments in shader cores before passing them to fixed-function blending units. Our evaluation shows that VR-Pipe greatly improves rendering performance, achieving up to a 2.78x speedup over the conventional graphics pipeline with negligible hardware overhead.

📄 PDF Abstract BibTeX arXiv:2502.17078

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architectures

2022-07-30 · CVPR 2023 1 · Zhiqin Chen, Thomas Funkhouser, Peter Hedman, Andrea Tagliasacchi

Neural Radiance Fields (NeRFs) have demonstrated amazing ability to synthesize images of 3D scenes from novel views. However, they rely upon specialized volumetric rendering algorithms based on ray marching that are mism…

NeRFNovel View Synthesis

Dressi: A Hardware-Agnostic Differentiable Renderer with Reactive Shader Packing and Soft Rasterization

2022-04-04 · Yusuke Takimoto, Hiroyuki Sato, Hikari Takehara, Keishiro Uragaki 외

Differentiable rendering (DR) enables various computer graphics and computer vision applications through gradient-based optimization with derivatives of the rendering equation. Most rasterization-based approaches are bui…

Inverse Rendering

Modular Primitives for High-Performance Differentiable Rendering

2020-11-06 · Samuli Laine, Janne Hellsten, Tero Karras, Yeongho Seol 외

We present a modular differentiable renderer design that yields performance superior to previous methods by leveraging existing, highly optimized hardware graphics pipelines. Our design supports all crucial operations in…

AttributeInverse RenderingVocal Bursts Intensity Prediction

Instant Volumetric Head Avatars

2022-11-22 · CVPR 2023 1 · Wojciech Zielonka, Timo Bolkart, Justus Thies

We present Instant Volumetric Head Avatars (INSTA), a novel approach for reconstructing photo-realistic digital avatars instantaneously. INSTA models a dynamic neural radiance field based on neural graphics primitives em…

Face ModelGPU

From Volume Rendering to 3D Gaussian Splatting: Theory and Applications

2025-10-20 · Vitor Pereira Matias, Daniel Perazzo, Vinicius Silva, Alberto Raposo 외 arxiv

The problem of 3D reconstruction from posed images is undergoing a fundamental transformation, driven by continuous advances in 3D Gaussian Splatting (3DGS). By modeling scenes explicitly as collections of 3D Gaussians, …

Novel View Synthesis3D Reconstruction