paper-with-me

홈 › Papers

Deep Boltzmann Machines in Estimation of Distribution Algorithms for Combinatorial Optimization

2015-09-22 · Malte Probst, Franz Rothlauf

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Deep Boltzmann Machines (DBMs) are generative neural networks with these desired properties. We integrate a DBM into an EDA and evaluate the performance of this system in solving combinatorial optimization problems with a single objective. We compare the results to the Bayesian Optimization Algorithm. The performance of DBM-EDA was superior to BOA for difficult additively decomposable functions, i.e., concatenated deceptive traps of higher order. For most other benchmark problems, DBM-EDA cannot clearly outperform BOA, or other neural network-based EDAs. In particular, it often yields optimal solutions for a subset of the runs (with fewer evaluations than BOA), but is unable to provide reliable convergence to the global optimum competitively. At the same time, the model building process is computationally more expensive than that of other EDAs using probabilistic models from the neural network family, such as DAE-EDA.

📄 PDF Abstract BibTeX arXiv:1509.06535

Code (1)

wohnjayne/eda-suite 공식 구현

Tasks

Bayesian OptimizationCombinatorial Optimization

Similar Papers 제목 키워드 기반

Scalability of using Restricted Boltzmann Machines for Combinatorial Optimization

2014-11-27 · Malte Probst, Franz Rothlauf, Jörn Grahl

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Restricted Boltzmann Machines (RBMs) are generative neural networks with these desired propert…

Bayesian OptimizationCombinatorial OptimizationCPU

Transductive Boltzmann Machines

2018-05-21 · Mahito Sugiyama, Koji Tsuda, Hiroyuki Nakahara

We present transductive Boltzmann machines (TBMs), which firstly achieve transductive learning of the Gibbs distribution. While exact learning of the Gibbs distribution is impossible by the family of existing Boltzmann m…

Transductive Learning

Boltzmann Reinforcement Learning for Noise resilience in Analog Ising Machines

2026-02-09 · Aditya Choudhary, Saaketh Desai, Prasad Iyer arxiv

Analog Ising machines (AIMs) have emerged as a promising paradigm for combinatorial optimization, utilizing physical dynamics to solve Ising problems with high energy efficiency. However, the performance of traditional o…

Reinforcement Learning

Unlocking the Power of Boltzmann Machines by Parallelizable Sampler and Efficient Temperature Estimation

2025-12-02 · Kentaro Kubo, Hayato Goto arxiv

Boltzmann machines (BMs) are powerful energy-based generative models, but their heavy training cost has largely confined practical use to Restricted BMs (RBMs) trained with an efficient learning method called contrastive…

Can Boltzmann Machines Discover Cluster Updates ?

2017-02-28 · Lei Wang

Boltzmann machines are physics informed generative models with wide applications in machine learning. They can learn the probability distribution from an input dataset and generate new samples accordingly. Applying them …

Recommendation Systems