A Conservation Law Method in Optimization
We propose some algorithms to find local minima in nonconvex optimization and to obtain global minima in some degree from the Newton Second Law without friction. With the key observation of the velocity observable and controllable in the motion, the algorithms simulate the Newton Second Law without friction based on symplectic Euler scheme. From the intuitive analysis of analytical solution, we give a theoretical analysis for the high-speed convergence in the algorithm proposed. Finally, we propose the experiments for strongly convex function, non-strongly convex function and nonconvex function in high-dimension.
Code (0)
등록된 구현이 없습니다.
Tasks
FrictionSimilar Papers 제목 키워드 기반
Lagrangian dual framework for conservative neural network solutions of kinetic equations
In this paper, we propose a novel conservative formulation for solving kinetic equations via neural networks. More precisely, we formulate the learning problem as a constrained optimization problem with constraints that …
Guaranteeing Conservation of Integrals with Projection in Physics-Informed Neural Networks
We propose a novel projection method that guarantees the conservation of integral quantities in Physics-Informed Neural Networks (PINNs). While the soft constraint that PINNs use to enforce the structure of partial diffe…
Abide by the Law and Follow the Flow: Conservation Laws for Gradient Flows
Understanding the geometric properties of gradient descent dynamics is a key ingredient in deciphering the recent success of very large machine learning models. A striking observation is that trained over-parameterized m…
Conservation of Charge and Conservation of Current
Conservation of current and conservation of charge are nearly the same thing: when enough is known about charge movement, conservation of current can be derived from conservation of charge, in ideal dielectrics, for exam…
The dark side of the forces: assessing non-conservative force models for atomistic machine learning
The use of machine learning to estimate the energy of a group of atoms, and the forces that drive them to more stable configurations, has revolutionized the fields of computational chemistry and materials discovery. In t…
Computational chemistryComputational Efficiency