paper-with-me

홈 › Papers

Zero Grads: Learning Local Surrogate Losses for Non-Differentiable Graphics

2023-08-10 · Michael Fischer, Tobias Ritschel

Gradient-based optimization is now ubiquitous across graphics, but unfortunately can not be applied to problems with undefined or zero gradients. To circumvent this issue, the loss function can be manually replaced by a ``surrogate'' that has similar minima but is differentiable. Our proposed framework, ZeroGrads, automates this process by learning a neural approximation of the objective function, which in turn can be used to differentiate through arbitrary black-box graphics pipelines. We train the surrogate on an actively smoothed version of the objective and encourage locality, focusing the surrogate's capacity on what matters at the current training episode. The fitting is performed online, alongside the parameter optimization, and self-supervised, without pre-computed data or pre-trained models. As sampling the objective is expensive (it requires a full rendering or simulator run), we devise an efficient sampling scheme that allows for tractable run-times and competitive performance at little overhead. We demonstrate optimizing diverse non-convex, non-differentiable black-box problems in graphics, such as visibility in rendering, discrete parameter spaces in procedural modelling or optimal control in physics-driven animation. In contrast to other derivative-free algorithms, our approach scales well to higher dimensions, which we demonstrate on problems with up to 35k interlinked variables.

📄 PDF Abstract BibTeX arXiv:2308.05739

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Minimizing Surrogate Losses for Decision-Focused Learning using Differentiable Optimization

2025-08-15 · Jayanta Mandi, Ali İrfan Mahmutoğulları, Senne Berden, Tias Guns arxiv

Decision-focused learning (DFL) trains a machine learning (ML) model to predict parameters of an optimization problem, to directly minimize decision regret, i.e., maximize decision quality. Gradient-based DFL requires co…

On the Efficient Minimization of Classification Calibrated Surrogates

2008-12-01 · NeurIPS 2008 12 · Richard Nock, Frank Nielsen

Bartlett et al (2006) recently proved that a ground condition for convex surrogates, classification calibration, ties up the minimization of the surrogates and classification risks, and left as an important problem the a…

ClassificationGeneral Classification

Consistency Conditions for Differentiable Surrogate Losses

2025-05-19 · Drona Khurana, Anish Thilagar, Dhamma Kimpara, Rafael Frongillo

The statistical consistency of surrogate losses for discrete prediction tasks is often checked via the condition of calibration. However, directly verifying calibration can be arduous. Recent work shows that for polyhedr…

gradSLAM: Automagically differentiable SLAM

2019-10-23 · Krishna Murthy Jatavallabhula, Soroush Saryazdi, Ganesh Iyer, Liam Paull

Blending representation learning approaches with simultaneous localization and mapping (SLAM) systems is an open question, because of their highly modular and complex nature. Functionally, SLAM is an operation that trans…

Open-Ended Question AnsweringRepresentation LearningSimultaneous Localization and Mapping

GradSign: Model Performance Inference with Theoretical Insights

2021-10-16 · ICLR 2022 4 · Zhihao Zhang, Zhihao Jia

A key challenge in neural architecture search (NAS) is quickly inferring the predictive performance of a broad spectrum of networks to discover statistically accurate and computationally efficient ones. We refer to this …

modelNeural Architecture Search