paper-with-me

홈 › Papers

A Memetic Algorithm based on Variational Autoencoder for Black-Box Discrete Optimization with Epistasis among Parameters

2025-04-30 · Aoi Kato, Kenta Kojima, Masahiro Nomura, Isao Ono

Black-box discrete optimization (BB-DO) problems arise in many real-world applications, such as neural architecture search and mathematical model estimation. A key challenge in BB-DO is epistasis among parameters where multiple variables must be modified simultaneously to effectively improve the objective function. Estimation of Distribution Algorithms (EDAs) provide a powerful framework for tackling BB-DO problems. In particular, an EDA leveraging a Variational Autoencoder (VAE) has demonstrated strong performance on relatively low-dimensional problems with epistasis while reducing computational cost. Meanwhile, evolutionary algorithms such as DSMGA-II and P3, which integrate bit-flip-based local search with linkage learning, have shown excellent performance on high-dimensional problems. In this study, we propose a new memetic algorithm that combines VAE-based sampling with local search. The proposed method inherits the strengths of both VAE-based EDAs and local search-based approaches: it effectively handles high-dimensional problems with epistasis among parameters without incurring excessive computational overhead. Experiments on NK landscapes -- a challenging benchmark for BB-DO involving epistasis among parameters -- demonstrate that our method outperforms state-of-the-art VAE-based EDA methods, as well as leading approaches such as P3 and DSMGA-II.

📄 PDF Abstract BibTeX arXiv:2504.21338

Code (0)

등록된 구현이 없습니다.

Tasks

Evolutionary AlgorithmsNeural Architecture Search

Similar Papers 제목 키워드 기반

MEMO-QCD: Quantum Density Estimation through Memetic Optimisation for Quantum Circuit Design

2024-06-12 · Juan E. Ardila-García, Vladimir Vargas-Calderón, Fabio A. González, Diego H. Useche 외

This paper presents a strategy for efficient quantum circuit design for density estimation. The strategy is based on a quantum-inspired algorithm for density estimation and a circuit optimisation routine based on memetic…

Density Estimation

Hierarchical Variational Models

2015-11-07 · Rajesh Ranganath, Dustin Tran, David M. Blei

Black box variational inference allows researchers to easily prototype and evaluate an array of models. Recent advances allow such algorithms to scale to high dimensions. However, a central question remains: How to speci…

Computational EfficiencyVariational Inference

A Parallel Memetic Algorithm to Solve the Vehicle Routing Problem with Time Windows

2014-02-27 · Jakub Nalepa, Zbigniew J. Czech

This paper presents a parallel memetic algorithm for solving the vehicle routing problem with time windows (VRPTW). The VRPTW is a well-known NP-hard discrete optimization problem with two objectives. The main objective …

Local Expectation Gradients for Black Box Variational Inference

2015-12-01 · NeurIPS 2015 12 · Michalis Titsias Rc Aueb, Miguel Lázaro-Gredilla

We introduce local expectation gradients which is a general purpose stochastic variational inference algorithm for constructing stochastic gradients by sampling from the variational distribution. This algorithm divides t…

Variational Inference

DVAE++: Discrete Variational Autoencoders with Overlapping Transformations

2018-02-14 · ICML 2018 7 · Arash Vahdat, William G. Macready, Zhengbing Bian, Amir Khoshaman 외

Training of discrete latent variable models remains challenging because passing gradient information through discrete units is difficult. We propose a new class of smoothing transformations based on a mixture of two over…

Image Generation