paper-with-me

Papers

Learning to Optimize by Differentiable Programming

2026-01-23 · Liping Tao, Xindi Tong, Chee Wei Tan arxiv

Solving massive-scale optimization problems requires scalable first-order methods with low per-iteration cost. This tutorial highlights a shift in optimization: using differentiable programming not only to execute algorithms but to learn how to design them. Modern frameworks such as PyTorch, TensorFlow, and JAX enable this paradigm through efficient automatic differentiation. Embedding first-order methods within these systems allows end-to-end training that improves convergence and solution quality. Guided by Fenchel-Rockafellar duality, the tutorial demonstrates how duality-informed iterative schemes such as the alternating direction method of multipliers, and the primal-dual hybrid gradient can be learned and adapted through representative case studies.

📄 PDF Abstract BibTeX arXiv:2601.16510

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DiffTaichi: Differentiable Programming for Physical Simulation

2019-10-01 · ICLR 2020 1 · Yuanming Hu, Luke Anderson, Tzu-Mao Li, Qi Sun 외

We present DiffTaichi, a new differentiable programming language tailored for building high-performance differentiable physical simulators. Based on an imperative programming language, DiffTaichi generates gradients of s…

Physical Simulations

Using Differentiable Programming for Flexible Statistical Modeling

2020-12-07 · Maren Hackenberg, Marlon Grodd, Clemens Kreutz, Martina Fischer 외

Differentiable programming has recently received much interest as a paradigm that facilitates taking gradients of computer programs. While the corresponding flexible gradient-based optimization approaches so far have bee…

RayTracer.jl: A Differentiable Renderer that supports Parameter Optimization for Scene Reconstruction

2019-07-16 · Avik Pal

In this paper, we present RayTracer.jl, a renderer in Julia that is fully differentiable using source-to-source Automatic Differentiation (AD). This means that RayTracer not only renders 2D images from 3D scene parameter…

Deep Learning Explicit Differentiable Predictive Control Laws for Buildings

2021-07-25 · Jan Drgona, Aaron Tuor, Soumya Vasisht, Elliott Skomski 외

We present a differentiable predictive control (DPC) methodology for learning constrained control laws for unknown nonlinear systems. DPC poses an approximate solution to multiparametric programming problems emerging fro…

Deep LearningModel Predictive Control

Differentiable Vertex Fitting for Jet Flavour Tagging

2023-10-19 · Rachel E. C. Smith, Inês Ochoa, Rúben Inácio, Jonathan Shoemaker 외

We propose a differentiable vertex fitting algorithm that can be used for secondary vertex fitting, and that can be seamlessly integrated into neural networks for jet flavour tagging. Vertex fitting is formulated as an o…