Photon Field Networks for Dynamic Real-Time Volumetric Global Illumination
Volume data is commonly found in many scientific disciplines, like medicine, physics, and biology. Experts rely on robust scientific visualization techniques to extract valuable insights from the data. Recent years have shown path tracing to be the preferred approach for volumetric rendering, given its high levels of realism. However, real-time volumetric path tracing often suffers from stochastic noise and long convergence times, limiting interactive exploration. In this paper, we present a novel method to enable real-time global illumination for volume data visualization. We develop Photon Field Networks -- a phase-function-aware, multi-light neural representation of indirect volumetric global illumination. The fields are trained on multi-phase photon caches that we compute a priori. Training can be done within seconds, after which the fields can be used in various rendering tasks. To showcase their potential, we develop a custom neural path tracer, with which our photon fields achieve interactive framerates even on large datasets. We conduct in-depth evaluations of the method's performance, including visual quality, stochastic noise, inference and rendering speeds, and accuracy regarding illumination and phase function awareness. Results are compared to ray marching, path tracing and photon mapping. Our findings show that Photon Field Networks can faithfully represent indirect global illumination across the phase spectrum while exhibiting less stochastic noise and rendering at a significantly faster rate than traditional methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Data VisualizationSimilar Papers 제목 키워드 기반
Fast whole-brain imaging of seizures in zebrafish larvae by two-photon light-sheet microscopy
Light-sheet fluorescence microscopy (LSFM) enables real-time whole-brain functional imaging in zebrafish larvae. Conventional one photon LSFM can however induce undesirable visual stimulation due to the use of visible ex…
Single-photon Image Super-resolution via Self-supervised Learning
Single-Photon Image Super-Resolution (SPISR) aims to recover a high-resolution volumetric photon counting cube from a noisy low-resolution one by computational imaging algorithms. In real-world scenarios, pairs of traini…
Image Super-ResolutionSelf-Supervised LearningSuper-ResolutionAutomatic Differentiation for All Photons Imaging to See Inside Volumetric Scattering Media
Imaging through dense scattering media - such as biological tissue, fog, and smoke - has applications in the medical and robotics fields. We propose a new framework using automatic differentiation for All Photons Imaging…
AllPositionHPC-Driven Modeling with ML-Based Surrogates for Magnon-Photon Dynamics in Hybrid Quantum Systems
Simulating hybrid magnonic quantum systems remains a challenge due to the large disparity between the timescales of the two systems. We present a massively parallel GPU-based simulation framework that enables fully coupl…
FPGA-based real-time autocorrelator and its application in dynamic light scattering
Digital correlators play a significant role in dynamic light scattering (DLS) technology, which characterizes particle size distribution. We present a field programmable gate array (FPGA)-based digital correlator that ca…