paper-with-me

홈 › Papers

Further properties of the forward-backward envelope with applications to difference-of-convex programming

2016-05-01 · Tianxiang Liu, Ting Kei Pong

In this paper, we further study the forward-backward envelope first introduced in [28] and [30] for problems whose objective is the sum of a proper closed convex function and a twice continuously differentiable possibly nonconvex function with Lipschitz continuous gradient. We derive sufficient conditions on the original problem for the corresponding forward-backward envelope to be a level-bounded and Kurdyka-{\L}ojasiewicz function with an exponent of $\frac12$; these results are important for the efficient minimization of the forward-backward envelope by classical optimization algorithms. In addition, we demonstrate how to minimize some difference-of-convex regularized least squares problems by minimizing a suitably constructed forward-backward envelope. Our preliminary numerical results on randomly generated instances of large-scale $\ell_{1-2}$ regularized least squares problems [37] illustrate that an implementation of this approach with a limited-memory BFGS scheme usually outperforms standard first-order methods such as the nonmonotone proximal gradient method in [35].

📄 PDF Abstract BibTeX arXiv:1605.00201

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Proximal Algorithms in Statistics and Machine Learning

2015-02-11 · Nicholas G. Polson, James G. Scott, Brandon T. Willard

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach explo…

BIG-bench Machine Learningregression

From stability of Langevin diffusion to convergence of proximal MCMC for non-log-concave sampling

2025-05-20 · Marien Renaud, Valentin De Bortoli, Arthur Leclaire, Nicolas Papadakis

We consider the problem of sampling distributions stemming from non-convex potentials with Unadjusted Langevin Algorithm (ULA). We prove the stability of the discrete-time ULA to drift approximations under the assumption…

A New Strategy for Verifying Reach-Avoid Specifications in Neural Feedback Systems

2026-01-12 · Samuel I. Akinwande, Sydney M. Katz, Mykel J. Kochenderfer, Clark Barrett arxiv

Forward reachability analysis is the predominant approach for verifying reach-avoid properties in neural feedback systems (dynamical systems controlled by neural networks). This dominance stems from the limited scalabili…

Mixture Manifold Networks: A Computationally Efficient Baseline for Inverse Modeling

2022-11-25 · Gregory P. Spell, Simiao Ren, Leslie M. Collins, Jordan M. Malof

We propose and show the efficacy of a new method to address generic inverse problems. Inverse modeling is the task whereby one seeks to determine the control parameters of a natural system that produce a given set of obs…

Forward-Backward Reasoning in Large Language Models for Mathematical Verification

2023-08-15 · Weisen Jiang, Han Shi, Longhui Yu, Zhengying Liu 외

Self-Consistency samples diverse reasoning chains with answers and chooses the final answer by majority voting. It is based on forward reasoning and cannot further improve performance by sampling more reasoning chains wh…

Mathematical Reasoning