paper-with-me

Papers

Continuation Newton methods with deflation techniques for global optimization problems

2021-07-29 · Xin-long Luo, Hang Xiao, Sen Zhang

The global minimum point of an optimization problem is of interest in engineering fields and it is difficult to be found, especially for a nonconvex large-scale optimization problem. In this article, we consider a new memetic algorithm for this problem. That is to say, we use the continuation Newton method with the deflation technique to find multiple stationary points of the objective function and use those found stationary points as the initial seeds of the evolutionary algorithm, other than the random initial seeds of the known evolutionary algorithms. Meanwhile, in order to retain the usability of the derivative-free method and the fast convergence of the gradient-based method, we use the automatic differentiation technique to compute the gradient and replace the Hessian matrix with its finite difference approximation. According to our numerical experiments, this new algorithm works well for unconstrained optimization problems and finds their global minima efficiently, in comparison to the other representative global optimization methods such as the multi-start methods (the built-in subroutine GlobalSearch.m of MATLAB R2021b, GLODS and VRBBO), the branch-and-bound method (Couenne, a state-of-the-art open-source solver for mixed integer nonlinear programming problems), and the derivative-free algorithms (CMA-ES and MCS).

📄 PDF Abstract BibTeX arXiv:2107.13864

Code (1)

luoxinlongroger/cnmge 공식 구현

Tasks

Evolutionary Algorithmsglobal-optimization

Similar Papers 제목 키워드 기반

Improving Pseudo-Time Stepping Convergence for CFD Simulations With Neural Networks

2023-10-10 · Anouk Zandbergen, Tycho van Noorden, Alexander Heinlein

Computational fluid dynamics (CFD) simulations of viscous fluids described by the Navier-Stokes equations are considered. Depending on the Reynolds number of the flow, the Navier-Stokes equations may exhibit a highly non…

Augmented Newton Method for Optimization: Global Linear Rate and Momentum Interpretation

2022-05-23 · Md Sarowar Morshed

We propose two variants of Newton method for solving unconstrained minimization problem. Our method leverages optimization techniques such as penalty and augmented Lagrangian method to generate novel variants of the Newt…

Deflation Methods for Sparse PCA

2008-12-01 · NeurIPS 2008 12 · Lester W. Mackey

In analogy to the PCA setting, the sparse PCA problem is often solved by iteratively alternating between two subtasks: cardinality-constrained rank-one variance maximization and matrix deflation. While the former has rec…

Deflation-Free Optimal Scoring

2026-04-28 · Sharmin Afroz, Brendan Ames arxiv

Sparse Optimal Scoring (SOS) reformulates linear discriminant analysis to enable feature selection through elastic net regularization, making it well-suited for high-dimensional settings where the number of features exce…

Multi-Rank Sparse and Functional PCA: Manifold Optimization and Iterative Deflation Techniques

2019-07-28 · Michael Weylandt

We consider the problem of estimating multiple principal components using the recently-proposed Sparse and Functional Principal Components Analysis (SFPCA) estimator. We first propose an extension of SFPCA which estimate…