Student's t Distribution based Estimation of Distribution Algorithms for Derivative-free Global Optimization
In this paper, we are concerned with a branch of evolutionary algorithms termed estimation of distribution (EDA), which has been successfully used to tackle derivative-free global optimization problems. For existent EDA algorithms, it is a common practice to use a Gaussian distribution or a mixture of Gaussian components to represent the statistical property of available promising solutions found so far. Observing that the Student's t distribution has heavier and longer tails than the Gaussian, which may be beneficial for exploring the solution space, we propose a novel EDA algorithm termed ESTDA, in which the Student's t distribution, rather than Gaussian, is employed. To address hard multimodal and deceptive problems, we extend ESTDA further by substituting a single Student's t distribution with a mixture of Student's t distributions. The resulting algorithm is named as estimation of mixture of Student's t distribution algorithm (EMSTDA). Both ESTDA and EMSTDA are evaluated through extensive and in-depth numerical experiments using over a dozen of benchmark objective functions. Empirical results demonstrate that the proposed algorithms provide remarkably better performance than their Gaussian counterparts.
Code (0)
등록된 구현이 없습니다.
Tasks
Evolutionary Algorithmsglobal-optimizationSimilar Papers 제목 키워드 기반
EM Estimation of Conditional Matrix Variate $t$ Distributions
Conditional matrix variate student $t$ distribution was introduced by Battulga (2024a). In this paper, we propose a new version of the conditional matrix variate student $t$ distribution. The paper provides EM algorithms…
Derivative Estimation in Random Design
We propose a nonparametric derivative estimation method for random design without having to estimate the regression function. The method is based on a variance-reducing linear combination of symmetric difference quotient…
regressionVariational Inference using Implicit Distributions
Generative adversarial networks (GANs) have given us a great tool to fit implicit generative models to data. Implicit distributions are ones we can sample from easily, and take derivatives of samples with respect to mode…
DenoisingDensity Ratio EstimationImage ReconstructionVariational InferenceKnowledge Distillation for 6D Pose Estimation by Aligning Distributions of Local Predictions
Knowledge distillation facilitates the training of a compact student network by using a deep teacher one. While this has achieved great success in many tasks, it remains completely unstudied for image-based 6D object pos…
6D Pose Estimation6D Pose Estimation using RGBKnowledge DistillationPose Estimation+1A Malliavin calculus approach to score functions in diffusion generative models
Score-based diffusion generative models have recently emerged as a powerful tool for modelling complex data distributions. These models aim at learning the score function, which defines a map from a known probability dis…