paper-with-me

Papers

Exploratory Landscape Analysis for Mixed-Variable Problems

2024-02-26 · Raphael Patrick Prager, Heike Trautmann

Exploratory landscape analysis and fitness landscape analysis in general have been pivotal in facilitating problem understanding, algorithm design and endeavors such as automated algorithm selection and configuration. These techniques have largely been limited to search spaces of a single domain. In this work, we provide the means to compute exploratory landscape features for mixed-variable problems where the decision space is a mixture of continuous, binary, integer, and categorical variables. This is achieved by utilizing existing encoding techniques originating from machine learning. We provide a comprehensive juxtaposition of the results based on these different techniques. To further highlight their merit for practical applications, we design and conduct an automated algorithm selection study based on a hyperparameter optimization benchmark suite. We derive a meaningful compartmentalization of these benchmark problems by clustering based on the used landscape features. The identified clusters mimic the behavior the used algorithms exhibit. Meaning, the different clusters have different best performing algorithms. Finally, our trained algorithm selector is able to close the gap between the single best and the virtual best solver by 57.5% over all benchmark problems.

📄 PDF Abstract BibTeX arXiv:2402.16467

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperparameter Optimization

Similar Papers 제목 키워드 기반

Hybridizing Target- and SHAP-encoded Features for Algorithm Selection in Mixed-variable Black-box Optimization

2024-07-10 · Konstantin Dietrich, Raphael Patrick Prager, Carola Doerr, Heike Trautmann

Exploratory landscape analysis (ELA) is a well-established tool to characterize optimization problems via numerical features. ELA is used for problem comprehension, algorithm design, and applications such as automated al…

Towards Exploratory Quality Diversity Landscape Analysis

2024-05-22 · Kyriacos Mosphilis, Vassilis Vassiliades

This work is a preliminary study on using Exploratory Landscape Analysis (ELA) for Quality Diversity (QD) problems. We seek to understand whether ELA features can potentially be used to characterise QD problems paving th…

Diversity

Computational and Exploratory Landscape Analysis of the GKLS Generator

2023-04-18 · Jakub Kudela, Martin Juricek

The GKLS generator is one of the most used testbeds for benchmarking global optimization algorithms. In this paper, we conduct both a computational analysis and the Exploratory Landscape Analysis (ELA) of the GKLS genera…

Benchmarkingglobal-optimization

The Landscape of R Packages for Automated Exploratory Data Analysis

2019-03-27 · Mateusz Staniak, Przemyslaw Biecek

The increasing availability of large but noisy data sets with a large number of heterogeneous variables leads to the increasing interest in the automation of common tasks for data analysis. The most time-consuming part o…

Feature Engineering

HPO X ELA: Investigating Hyperparameter Optimization Landscapes by Means of Exploratory Landscape Analysis

2022-07-30 · Lennart Schneider, Lennart Schäpermeier, Raphael Patrick Prager, Bernd Bischl 외

Hyperparameter optimization (HPO) is a key component of machine learning models for achieving peak predictive performance. While numerous methods and algorithms for HPO have been proposed over the last years, little prog…

Hyperparameter Optimization