paper-with-me

홈 › Papers

A machine learning approach for fighting the curse of dimensionality in global optimization

2021-10-28 · Julian F. Schumann, Alejandro M. Aragón

Finding global optima in high-dimensional optimization problems is extremely challenging since the number of function evaluations required to sufficiently explore the search space increases exponentially with its dimensionality. Furthermore, multimodal cost functions render local gradient-based search techniques ineffective. To overcome these difficulties, we propose to trim uninteresting regions of the search space where global optima are unlikely to be found by means of autoencoders, exploiting the lower intrinsic dimensionality of certain cost functions; optima are then searched over lower-dimensional latent spaces. The methodology is tested on benchmark functions and on multiple variations of a structural topology optimization problem, where we show that we can estimate this intrinsic lower dimensionality and based thereon obtain the global optimum at best or superior results compared to established optimization procedures at worst.

📄 PDF Abstract BibTeX arXiv:2110.14985

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learningglobal-optimization

Similar Papers 제목 키워드 기반

Learning in High-Dimensional Multimedia Data: The State of the Art

2017-07-10 · Lianli Gao, Jingkuan Song, Xingyi Liu, Junming Shao 외

During the last decade, the deluge of multimedia data has impacted a wide range of research areas, including multimedia retrieval, 3D tracking, database management, data mining, machine learning, social media analysis, m…

BIG-bench Machine Learningfeature selectionManagementRetrieval+1

SCORE: A 1D Reparameterization Technique to Break Bayesian Optimization's Curse of Dimensionality

2024-06-18 · Joseph Chakar

Bayesian optimization (BO) has emerged as a powerful tool for navigating complex search spaces, showcasing practical applications in the fields of science and engineering.However, since it typically relies on a surrogate…

Bayesian Optimization

Curse of Dimensionality in Neural Network Optimization

2025-02-07 · Sanghoon Na, Haizhao Yang

This paper demonstrates that when a shallow neural network with a Lipschitz continuous activation function is trained using either empirical or population risk to approximate a target function that is $r$ times continuou…

Finite-Sample Guarantees for Wasserstein Distributionally Robust Optimization: Breaking the Curse of Dimensionality

2020-09-09 · Rui Gao

Wasserstein distributionally robust optimization (DRO) aims to find robust and generalizable solutions by hedging against data perturbations in Wasserstein distance. Despite its recent empirical success in operations res…

Scalable Constrained Bayesian Optimization

2020-02-20 · David Eriksson, Matthias Poloczek

The global optimization of a high-dimensional black-box function under black-box constraints is a pervasive task in machine learning, control, and engineering. These problems are challenging since the feasible set is typ…

Bayesian Optimizationglobal-optimization