paper-with-me

Papers

Projected Hessian Learning: Fast Curvature Supervision for Accurate Machine-Learning Interatomic Potentials

2026-03-04 · Austin Rodriguez, Justin S. Smith, Sakib Matin, Nicholas Lubbers, Kipton Barros, Jose L. Mendoza-Cortes arxiv

The Hessian matrix (second derivatives) encodes far richer local curvature of the potential energy surface than energies and forces alone. However, training machine-learning interatomic potentials (MLIPs) with full Hessians is often impractical because explicitly forming and storing Hessian matrices scales quadratically in cost and memory. We introduce Projected Hessian Learning (PHL), a scalable second-order training framework that injects curvature information using only Hessian-vector products (HVPs). Rather than constructing the Hessian, PHL projects curvature along stochastic probe directions and uses an unbiased stochastic trace-based loss with favorable system-size scaling, enabling curvature-informed training without quadratic memory growth. We benchmark PHL on a chemically diverse dataset of reactants, products, transition states, intrinsic reaction coordinates, and normal-mode sampled geometries computed at omegaB97XD/6-31G(d). We compare energy-force training (E-F), two HVP-based schemes (E-F-HVP with one-hot or randomized probes), and full energy-force-Hessian training (E-F-H). With randomized probes per minibatch, both HVP schemes match full-Hessian training in energy, force, and Hessian accuracy while delivering >24x epoch speedups for the small molecular systems studied. In a fixed-probe regime with one HVP per molecule, randomized projections consistently outperform one-column probing, especially for far-from-equilibrium geometries. Overall, PHL replaces explicit Hessian supervision with force-complexity curvature training, retaining most second-order accuracy gains while scaling to larger, more complex molecular systems.

📄 PDF Abstract BibTeX arXiv:2603.04523

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hessian Matching for Machine-Learned Coarse-Grained Molecular Dynamics

2026-05-12 · Sanya Murdeshwar, Sanjit Shashi, Kevin Bachelor, William Noid 외 arxiv

Coarse-grained (CG) molecular dynamics enables simulations of atomic systems such as biomolecules at timescales inaccessible to all-atom (AA) methods, but existing CG neural potentials trained via force matching capture …

Hessian-informed machine learning interatomic potential towards bridging theory and experiments

2026-03-26 · Bangchen Yin, Jian Ouyang, Zhen Fan, Kailai Lin 외 arxiv

Local curvature of potential energy surfaces is critical for predicting certain experimental observables of molecules and materials from first principles, yet it remains far beyond reach for complex systems. In this work…

Taming Curvature: Architecture Warm-Up for Stable Transformer Training

2026-06-15 · Sameera Ramasinghe, Ajanthan Thalaiyasingam, Hadi Mohaghegh Dolatabadi, Chamin Hewa Koneputugodage 외 arxiv

Training billion-parameter Transformers is often brittle, with transient loss spikes and divergence that waste compute. Even though the recently developed Edge of Stability (EoS) theory provides a powerful tool to unders…

FlatCAD: Fast Curvature Regularization of Neural SDFs for CAD Models

2025-06-19 · Haotian Yin, Aleksander Plocharski, Michal Jan Wlodarczyk, Mikolaj Kida 외

Neural signed-distance fields (SDFs) have become a versatile backbone for geometric learning, yet enforcing developable, CAD-style behavior still hinges on Gaussian curvature penalties that require full Hessian evaluatio…

GPU

Projected Stein Variational Newton: A Fast and Scalable Bayesian Inference Method in High Dimensions

2019-12-01 · NeurIPS 2019 12 · Peng Chen, Keyi Wu, Joshua Chen, Tom O'Leary-Roseberry 외

We propose a projected Stein variational Newton (pSVN) method for high-dimensional Bayesian inference. To address the curse of dimensionality, we exploit the intrinsic low-dimensional geometric structure of the posterior…

Bayesian Inference