paper-with-me

Papers

Expanding variational autoencoders for learning and exploiting latent representations in search distributions

2018-07-01 · Unai Garciarena, Roberto Santana, Alexander Mendiburu

In the past, evolutionary algorithms (EAs) that use probabilistic modeling of the best solutions incorporated latent or hidden vari- ables to the models as a more accurate way to represent the search distributions. Recently, a number of neural-network models that compute approximations of posterior (latent variable) distributions have been introduced. In this paper, we investigate the use of the variational autoencoder (VAE), a class of neural-network based generative model, for modeling and sampling search distributions as part of an estimation of distribution algorithm. We show that VAE can capture dependencies between decision variables and ob- jectives. This feature is proven to improve the sampling capacity of model based EAs. Furthermore, we extend the original VAE model by adding a new, fitness-approximating network component. We show that it is possible to adapt the architecture of these models and we present evidence of how to extend VAEs to better fulfill the requirements of probabilistic modeling in EAs. While our results are not yet competitive with state of the art probabilistic-based optimizers, they represent a promising direction for the application of generative models within EDAs.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Evolutionary Algorithms

Methods 이 논문이 사용한 방법론

USD Coin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

MTC-VAE: Multi-Level Temporal Compression with Content Awareness

2026-02-01 · Yubo Dong, Linchao Zhu arxiv

Latent Video Diffusion Models (LVDMs) rely on Variational Autoencoders (VAEs) to compress videos into compact latent representations. For continuous Variational Autoencoders (VAEs), achieving higher compression rates is …

IntroVAC: Introspective Variational Classifiers for Learning Interpretable Latent Subspaces

2020-08-03 · Marco Maggipinto, Matteo Terzi, Gian Antonio Susto

Learning useful representations of complex data has been the subject of extensive research for many years. With the diffusion of Deep Neural Networks, Variational Autoencoders have gained lots of attention since they pro…

Decoder

Posterior Collapse and Latent Variable Non-identifiability

2023-01-02 · NeurIPS 2021 12 · Yixin Wang, David M. Blei, John P. Cunningham

Variational autoencoders model high-dimensional data by positing low-dimensional latent variables that are mapped through a flexible distribution parametrized by a neural network. Unfortunately, variational autoencoders …

AttributeVariational Inference

Revisiting Structured Variational Autoencoders

2023-05-25 · Yixiu Zhao, Scott W. Linderman

Structured variational autoencoders (SVAEs) combine probabilistic graphical model priors on latent variables, deep neural networks to link latent variables to observed data, and structure-exploiting algorithms for approx…

Text Modeling with Syntax-Aware Variational Autoencoders

2019-08-27 · Yijun Xiao, William Yang Wang

Syntactic information contains structures and rules about how text sentences are arranged. Incorporating syntax into text modeling methods can potentially benefit both representation learning and generation. Variational …

Representation Learning