paper-with-me

Papers

Towards Exploratory Landscape Analysis for Large-scale Optimization: A Dimensionality Reduction Framework

2021-04-21 · Ryoji Tanabe

Although exploratory landscape analysis (ELA) has shown its effectiveness in various applications, most previous studies focused only on low- and moderate-dimensional problems. Thus, little is known about the scalability of the ELA approach for large-scale optimization. In this context, first, this paper analyzes the computational cost of features in the flacco package. Our results reveal that two important feature classes (ela_level and ela_meta) cannot be applied to large-scale optimization due to their high computational cost. To improve the scalability of the ELA approach, this paper proposes a dimensionality reduction framework that computes features in a reduced lower-dimensional space than the original solution space. We demonstrate that the proposed framework can drastically reduce the computation time of ela_level and ela_meta for large dimensions. In addition, the proposed framework can make the cell-mapping feature classes scalable for large-scale optimization. Our results also show that features computed by the proposed framework are beneficial for predicting the high-level properties of the 24 large-scale BBOB functions.

📄 PDF Abstract BibTeX arXiv:2104.10301

Code (1)

ryojitanabe/ela_drframework 공식 구현

Tasks

Dimensionality Reduction

Similar Papers 제목 키워드 기반

On the Hyperparameter Loss Landscapes of Machine Learning Models: An Exploratory Study

2023-11-23 · Mingyu Huang, Ke Li

Previous efforts on hyperparameter optimization (HPO) of machine learning (ML) models predominately focus on algorithmic advances, yet little is known about the topography of the underlying hyperparameter (HP) loss lands…

AutoMLHyperparameter OptimizationTransfer Learning

Neural Exploratory Landscape Analysis for Meta-Black-Box-Optimization

2024-08-20 · Zeyuan Ma, Jiacheng Chen, Hongshu Guo, Yue-Jiao Gong

Recent research in Meta-Black-Box Optimization (MetaBBO) have shown that meta-trained neural networks can effectively guide the design of black-box optimizers, significantly reducing the need for expert tuning and delive…

Exploratory Landscape Analysis for Mixed-Variable Problems

2024-02-26 · Raphael Patrick Prager, Heike Trautmann

Exploratory landscape analysis and fitness landscape analysis in general have been pivotal in facilitating problem understanding, algorithm design and endeavors such as automated algorithm selection and configuration. Th…

Hyperparameter Optimization

DoE2Vec: Deep-learning Based Features for Exploratory Landscape Analysis

2023-03-31 · Bas van Stein, Fu Xing Long, Moritz Frenzel, Peter Krause 외

We propose DoE2Vec, a variational autoencoder (VAE)-based methodology to learn optimization landscape characteristics for downstream meta-learning tasks, e.g., automated selection of optimization algorithms. Principally,…

Deep LearningFeature EngineeringMeta-Learning

Optimizing the Landscape of LLM Embeddings with Dynamic Exploratory Graph Analysis for Generative Psychometrics: A Monte Carlo Study

2026-01-14 · Hudson Golino arxiv

Large language model (LLM) embeddings are increasingly used to estimate dimensional structure in psychological item pools prior to data collection, yet current applications treat embeddings as static, cross-sectional rep…