paper-with-me

홈 › Papers

Scene Parameter Saliency via Differentiable Light Transport

2026-07-23 · Linas Beresna, Eugene Fiume arxiv

Gradient-based saliency methods reveal which input features most influence a neural network's output, and are a standard tool for model interpretability. We observe that differentiable renderers, which are conventionally used for parameter optimisation, produce an analogous form of saliency: given any scalar metric evaluated on a rendered image, a single reverse-mode differentiation pass yields per-parameter gradients that identify which scene elements most influence the metric. We call these gradient fields metric saliency maps. Unlike neural saliency, which propagates attribution through learned weights, metric saliency propagates through the image formation process itself, including multi-bounce light transport, capturing parameter dependencies that are semi-opaque to manual inspection. We compute metric saliency maps for qualitatively different objectives: psychovisual glare indices, mean scene luminance, and neural perceptual scores. The saliency rankings differ substantially across metrics for the same scene, with parameters that dominate one objective being negligible for another. The saliency map is specific to the metric, not an intrinsic property of the scene. Our results suggest that differentiable renderers produce derivative images that are as informative for scene understanding as the primal images they were designed to generate.

📄 PDF Abstract BibTeX arXiv:2607.21562

Code (0)

등록된 구현이 없습니다.

Tasks

Scene Understanding

Similar Papers 제목 키워드 기반

Plateau-reduced Differentiable Path Tracing

2022-11-30 · CVPR 2023 1 · Michael Fischer, Tobias Ritschel

Current differentiable renderers provide light transport gradients with respect to arbitrary scene parameters. However, the mere existence of these gradients does not guarantee useful update steps in an optimization. Ins…

Inverse Rendering

Inverse Transport Networks

2018-09-28 · Chengqian Che, Fujun Luan, Shuang Zhao, Kavita Bala 외

We introduce inverse transport networks as a learning architecture for inverse rendering problems where, given input image measurements, we seek to infer physical scene parameters such as shape, material, and illuminatio…

Inverse Rendering

Self-Calibrating, Fully Differentiable NLOS Inverse Rendering

2023-09-21 · Kiseok Choi, Inchul Kim, Dongyoung Choi, Julio Marco 외

Existing time-resolved non-line-of-sight (NLOS) imaging methods reconstruct hidden scenes by inverting the optical paths of indirect illumination measured at visible relay surfaces. These methods are prone to reconstruct…

Inverse Rendering

Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illumination

2022-07-27 · Linjie Lyu, Ayush Tewari, Thomas Leimkuehler, Marc Habermann 외

Given a set of images of a scene, the re-rendering of this scene from novel views and lighting conditions is an important and challenging problem in Computer Vision and Graphics. On the one hand, most existing works in C…

DisentanglementNovel View Synthesisparameter estimation

DensFiLM: Density-Conditioned Video Saliency for Crowd Scenes

2026-07-28 · Anis Ur Rahman arxiv

Video saliency models typically apply a single fixation strategy across crowd scenes, despite systematic changes in attention with crowd density. Sparse scenes encourage tracking individuals, whereas dense scenes shift a…