paper-with-me

홈 › Papers

Hybrid Genetic Algorithm and Hill Climbing Optimization for the Neural Network

2023-08-24 · Krutika Sarode, Shashidhar Reddy Javaji

In this paper, we propose a hybrid model combining genetic algorithm and hill climbing algorithm for optimizing Convolutional Neural Networks (CNNs) on the CIFAR-100 dataset. The proposed model utilizes a population of chromosomes that represent the hyperparameters of the CNN model. The genetic algorithm is used for selecting and breeding the fittest chromosomes to generate new offspring. The hill climbing algorithm is then applied to the offspring to further optimize their hyperparameters. The mutation operation is introduced to diversify the population and to prevent the algorithm from getting stuck in local optima. The Genetic Algorithm is used for global search and exploration of the search space, while Hill Climbing is used for local optimization of promising solutions. The objective function is the accuracy of the trained neural network on the CIFAR-100 test set. The performance of the hybrid model is evaluated by comparing it with the standard genetic algorithm and hill-climbing algorithm. The experimental results demonstrate that the proposed hybrid model achieves better accuracy with fewer generations compared to the standard algorithms. Therefore, the proposed hybrid model can be a promising approach for optimizing CNN models on large datasets.

📄 PDF Abstract BibTeX arXiv:2308.13099

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When Hillclimbers Beat Genetic Algorithms in Multimodal Optimization

2015-04-26 · Fernando G. Lobo, Mosab Bazargani

It has been shown in the past that a multistart hillclimbing strategy compares favourably to a standard genetic algorithm with respect to solving instances of the multimodal problem generator. We extend that work and ver…

Diversity

Non-Stationary Stochastic Global Optimization Algorithms

2020-10-11 · Jonatan Gomez, Carlos Rivera

Gomez proposes a formal and systematic approach for characterizing stochastic global optimization algorithms. Using it, Gomez formalizes algorithms with a fixed next-population stochastic method, i.e., algorithms defined…

global-optimizationLEMMA

Faster Optimization Through Genetic Drift

2024-04-18 · Cella Florescu, Marc Kaufmann, Johannes Lengler, Ulysse Schaller

The compact Genetic Algorithm (cGA), parameterized by its hypothetical population size $K$, offers a low-memory alternative to evolving a large offspring population of solutions. It evolves a probability distribution, bi…

A hybrid estimation of distribution algorithm for joint stratification and sample allocation

2022-01-09 · Mervyn O'Luing, Steven Prestwich, S. Armagan Tarim

In this study we propose a hybrid estimation of distribution algorithm (HEDA) to solve the joint stratification and sample allocation problem. This is a complex problem in which each the quality of each stratification fr…

When Does Hillclimbing Fail on Monotone Functions: An entropy compression argument

2018-08-03 · Johannes Lengler, Anders Martinsson, Angelika Steger

Hillclimbing is an essential part of any optimization algorithm. An important benchmark for hillclimbing algorithms on pseudo-Boolean functions $f: \{0,1\}^n \to \mathbb{R}$ are (strictly) montone functions, on which a s…