paper-with-me

Papers

Optimising Optimisers with Push GP

2019-10-02 · Michael Lones

This work uses Push GP to automatically design both local and population-based optimisers for continuous-valued problems. The optimisers are trained on a single function optimisation landscape, using random transformations to discourage overfitting. They are then tested for generality on larger versions of the same problem, and on other continuous-valued problems. In most cases, the optimisers generalise well to the larger problems. Surprisingly, some of them also generalise very well to previously unseen problems, outperforming existing general purpose optimisers such as CMA-ES. Analysis of the behaviour of the evolved optimisers indicates a range of interesting optimisation strategies that are not found within conventional optimisers, suggesting that this approach could be useful for discovering novel and effective forms of optimisation in an automated manner.

📄 PDF Abstract BibTeX arXiv:1910.00945

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Instruction-Level Design of Local Optimisers using Push GP

2019-05-24 · Michael Lones

This work uses genetic programming to explore the design space of local optimisation algorithms. Optimisers are expressed in the Push programming language, a stack-based language with a wide range of typed primitive inst…

Evolving Continuous Optimisers from Scratch

2021-03-22 · Michael A. Lones

This work uses genetic programming to explore the space of continuous optimisers, with the goal of discovering novel ways of doing optimisation. In order to keep the search space broad, the optimisers are evolved from sc…

Generalised envelope spectrum-based signal-to-noise objectives: Formulation, optimisation and application for gear fault detection under time-varying speed conditions

2024-04-26 · Stephan Schmidt, Daniel N. Wilke, Konstantinos C. Gryllias

In vibration-based condition monitoring, optimal filter design improves fault detection by enhancing weak fault signatures within vibration signals. This process involves optimising a derived objective function from a de…

Fault Detection

Adaptively Optimised Adaptive Importance Samplers

2023-07-18 · Carlos A. C. C. Perello, Ömer Deniz Akyildiz

We introduce a new class of adaptive importance samplers leveraging adaptive optimisation tools, which we term AdaOAIS. We build on Optimised Adaptive Importance Samplers (OAIS), a class of techniques that adapt proposal…

HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisation

2020-12-07 · Alexander I. Cowen-Rivers, Wenlong Lyu, Rasul Tutunov, Zhi Wang 외

In this work we rigorously analyse assumptions inherent to black-box optimisation hyper-parameter tuning tasks. Our results on the Bayesmark benchmark indicate that heteroscedasticity and non-stationarity pose significan…

Bayesian OptimisationBIG-bench Machine LearningHyperparameter Optimization