paper-with-me

홈 › Papers

3DGS$^2$-TR: Scalable Second-Order Trust-Region Method for 3D Gaussian Splatting

2026-01-30 · Roger Hsiao, Yuchen Fang, Xiangru Huang, Ruilong Li, Hesam Rabeti, Zan Gojcic, Javad Lavaei, James Demmel, Sophia Shao arxiv

We propose 3DGS$^2$-TR,a second-order optimizer for accelerating the scene training problem in 3D Gaussian Splatting (3DGS). Unlike existing second-order approaches that rely on explicit or dense curvature representations, such as 3DGS-LM (Höllein et al., 2025) or 3DGS2 (Lan et al., 2025), our method approximates curvature using only the diagonal of the Hessian matrix, efficiently via Hutchinson's method. Our approach is fully matrix-free and has the same complexity as ADAM (Kingma, 2024), $O(n)$ in both computation and memory costs. To ensure stable optimization in the presence of strong nonlinearity in the 3DGS rasterization process, we introduce a parameter-wise trust-region technique based on the squared Hellinger distance, regularizing updates to Gaussian parameters. Under identical parameter initialization and without densification, 3DGS$^2$-TR is able to achieve better reconstruction quality on standard datasets, using 50% fewer training iterations compared to ADAM, while incurring less than 1GB of peak GPU memory overhead (17% more than ADAM and 85% less than 3DGS-LM), enabling scalability to very large scenes and potentially to distributed training settings.

📄 PDF Abstract BibTeX arXiv:2602.00395

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Information-Theoretic Trust Regions for Stochastic Gradient-Based Optimization

2023-10-31 · Philipp Dahlinger, Philipp Becker, Maximilian Hüttenrauch, Gerhard Neumann

Stochastic gradient-based optimization is crucial to optimize neural networks. While popular approaches heuristically adapt the step size and direction by rescaling gradients, a more principled approach to improve optimi…

Fast Black-box Variational Inference through Stochastic Trust-Region Optimization

2017-06-07 · NeurIPS 2017 12 · Jeffrey Regier, Michael. I. Jordan, Jon Mcauliffe

We introduce TrustVI, a fast second-order algorithm for black-box variational inference based on trust-region optimization and the reparameterization trick. At each iteration, TrustVI proposes and assesses a step based o…

Variational Inference

Ellipsoidal Trust Region Methods for Neural Network Training

2019-09-25 · Leonard Adolphs, Jonas Kohler, Aurelien Lucchi

We investigate the use of ellipsoidal trust region constraints for second-order optimization of neural networks. This approach can be seen as a higher-order counterpart of adaptive gradient methods, which we here show to…

Efficient Second-Order Neural Network Optimization via Adaptive Trust Region Methods

2024-10-03 · James Vo

Second-order optimization methods offer notable advantages in training deep neural networks by utilizing curvature information to achieve faster convergence. However, traditional second-order techniques are computational…

Computational Efficiency

Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Models

2024-09-24 · Yuchen Fang, Sen Na, Michael W. Mahoney, Mladen Kolar

In this work, we consider solving optimization problems with a stochastic objective and deterministic equality constraints. We propose a Trust-Region Sequential Quadratic Programming method to find both first- and second…

Stochastic Optimization