paper-with-me

홈 › Papers

Derivative-free tree optimization for complex systems

2024-04-05 · Ye Wei, Bo Peng, Ruiwen Xie, Yangtao Chen, Yu Qin, Peng Wen, Stefan Bauer, Po-Yen Tung

A tremendous range of design tasks in materials, physics, and biology can be formulated as finding the optimum of an objective function depending on many parameters without knowing its closed-form expression or the derivative. Traditional derivative-free optimization techniques often rely on strong assumptions about objective functions, thereby failing at optimizing non-convex systems beyond 100 dimensions. Here, we present a tree search method for derivative-free optimization that enables accelerated optimal design of high-dimensional complex systems. Specifically, we introduce stochastic tree expansion, dynamic upper confidence bound, and short-range backpropagation mechanism to evade local optimum, iteratively approximating the global optimum using machine learning models. This development effectively confronts the dimensionally challenging problems, achieving convergence to global optima across various benchmark functions up to 2,000 dimensions, surpassing the existing methods by 10- to 20-fold. Our method demonstrates wide applicability to a wide range of real-world complex systems spanning materials, physics, and biology, considerably outperforming state-of-the-art algorithms. This enables efficient autonomous knowledge discovery and facilitates self-driving virtual laboratories. Although we focus on problems within the realm of natural science, the advancements in optimization techniques achieved herein are applicable to a broader spectrum of challenges across all quantitative disciplines.

📄 PDF Abstract BibTeX arXiv:2404.04062

Code (1)

bop2000/dots 공식 구현 tf

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Enhancing Optimization Performance: A Novel Hybridization of Gaussian Crunching Search and Powell's Method for Derivative-Free Optimization

2023-08-09 · Benny Wong

This research paper presents a novel approach to enhance optimization performance through the hybridization of Gaussian Crunching Search (GCS) and Powell's Method for derivative-free optimization. While GCS has shown pro…

A parallel implementation of the covariance matrix adaptation evolution strategy

2018-05-28 · Najeeb Khan

In many practical optimization problems, the derivatives of the functions to be optimized are unavailable or unreliable. Such optimization problems are solved using derivative-free optimization techniques. One of the sta…

Learning to Guide Random Search

2020-04-25 · ICLR 2020 1 · Ozan Sener, Vladlen Koltun

We are interested in derivative-free optimization of high-dimensional functions. The sample complexity of existing methods is high and depends on problem dimensionality, unlike the dimensionality-independent rates of fir…

Bayesian Optimizationcontinuous-controlContinuous Control

Derivative-Free Methods for Policy Optimization: Guarantees for Linear Quadratic Systems

2018-12-20 · Dhruv Malik, Ashwin Pananjady, Kush Bhatia, Koulik Khamaru 외

We study derivative-free methods for policy optimization over the class of linear policies. We focus on characterizing the convergence rate of these methods when applied to linear-quadratic systems, and study various set…

Scalable Acceleration for Classification-Based Derivative-Free Optimization

2023-09-20 · Tianyi Han, Jingya Li, Zhipeng Guo, Yuan Jin

Derivative-free optimization algorithms play an important role in scientific and engineering design optimization problems, especially when derivative information is not accessible. In this paper, we study the framework o…

ClassificationLanguage ModelingLanguage Modelling