paper-with-me

Papers

The Hessian Estimation Evolution Strategy

2020-03-30 · Tobias Glasmachers, Oswin Krause

We present a novel black box optimization algorithm called Hessian Estimation Evolution Strategy. The algorithm updates the covariance matrix of its sampling distribution by directly estimating the curvature of the objective function. This algorithm design is targeted at twice continuously differentiable problems. For this, we extend the cumulative step-size adaptation algorithm of the CMA-ES to mirrored sampling. We demonstrate that our approach to covariance matrix adaptation is efficient by evaluation it on the BBOB/COCO testbed. We also show that the algorithm is surprisingly robust when its core assumption of a twice continuously differentiable objective function is violated. The approach yields a new evolution strategy with competitive performance, and at the same time it also offers an interesting alternative to the usual covariance matrix update mechanism.

📄 PDF Abstract BibTeX arXiv:2003.13256

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Superlinearly Convergent Evolution Strategy

2025-05-16 · Tobias Glasmachers

We present a hybrid algorithm between an evolution strategy and a quasi Newton method. The design is based on the Hessian Estimation Evolution Strategy, which iteratively estimates the inverse square root of the Hessian …

Convergence Analysis of the Hessian Estimation Evolution Strategy

2020-09-06 · Tobias Glasmachers, Oswin Krause

The class of algorithms called Hessian Estimation Evolution Strategies (HE-ESs) update the covariance matrix of their sampling distribution by directly estimating the curvature of the objective function. The approach is …

An Investigation of the Bias-Variance Tradeoff in Meta-Gradients

2022-09-22 · Risto Vuorio, Jacob Beck, Shimon Whiteson, Jakob Foerster 외

Meta-gradients provide a general approach for optimizing the meta-parameters of reinforcement learning (RL) algorithms. Estimation of meta-gradients is central to the performance of these meta-algorithms, and has been st…

Meta-LearningReinforcement Learning (RL)

Revisiting Zeroth-Order Hessian Approximation: A Single-Step Policy Optimization Lens

2026-05-29 · Junbin Qiu, Zhaowei Hong, Renzhe Xu, Yao Shu arxiv

Accurate Zeroth-Order (ZO) Hessian estimation is a cornerstone of derivative-free methods, essential for tasks such as bilevel optimization, Bayesian inference, and uncertainty quantification. However, obtaining a comple…

Bilevel OptimizationBayesian Inference

Mirror Natural Evolution Strategies

2019-10-25 · Haishan Ye, Tong Zhang

Evolution Strategies such as CMA-ES (covariance matrix adaptation evolution strategy) and NES (natural evolution strategy) have been widely used in machine learning applications, where an objective function is optimized …