paper-with-me

홈 › Papers

Constrained Hybrid Metaheuristic Algorithm for Probabilistic Neural Networks Learning

2025-01-26 · Piotr A. Kowalski, Szymon Kucharczyk, Jacek Mańdziuk

This study investigates the potential of hybrid metaheuristic algorithms to enhance the training of Probabilistic Neural Networks (PNNs) by leveraging the complementary strengths of multiple optimisation strategies. Traditional learning methods, such as gradient-based approaches, often struggle to optimise high-dimensional and uncertain environments, while single-method metaheuristics may fail to exploit the solution space fully. To address these challenges, we propose the constrained Hybrid Metaheuristic (cHM) algorithm, a novel approach that combines multiple population-based optimisation techniques into a unified framework. The proposed procedure operates in two phases: an initial probing phase evaluates multiple metaheuristics to identify the best-performing one based on the error rate, followed by a fitting phase where the selected metaheuristic refines the PNN to achieve optimal smoothing parameters. This iterative process ensures efficient exploration and convergence, enhancing the network's generalisation and classification accuracy. cHM integrates several popular metaheuristics, such as BAT, Simulated Annealing, Flower Pollination Algorithm, Bacterial Foraging Optimization, and Particle Swarm Optimisation as internal optimisers. To evaluate cHM performance, experiments were conducted on 16 datasets with varying characteristics, including binary and multiclass classification tasks, balanced and imbalanced class distributions, and diverse feature dimensions. The results demonstrate that cHM effectively combines the strengths of individual metaheuristics, leading to faster convergence and more robust learning. By optimising the smoothing parameters of PNNs, the proposed method enhances classification performance across diverse datasets, proving its application flexibility and efficiency.

📄 PDF Abstract BibTeX arXiv:2501.15661

Code (0)

등록된 구현이 없습니다.

Tasks

Efficient Exploration

Similar Papers 제목 키워드 기반

Constrained Hybrid Metaheuristic: A Universal Framework for Continuous Optimisation

2026-03-18 · Piotr A. Kowalski, Szymon Kucharczyk, Jacek Mańdziuk arxiv

This paper presents the constrained Hybrid Metaheuristic (cHM) algorithm as a general framework for continuous optimisation. Unlike many existing metaheuristics that are tailored to specific function classes or problem d…

A socio-physics based hybrid metaheuristic for solving complex non-convex constrained optimization problems

2022-09-02 · Ishaan R Kale, Anand J Kulkarni, Efren Mezura-Montes

Several Artificial Intelligence based heuristic and metaheuristic algorithms have been developed so far. These algorithms have shown their superiority towards solving complex problems from different domains. However, it …

Gnowee: A Hybrid Metaheuristic Optimization Algorithm for Constrained, Black Box, Combinatorial Mixed-Integer Design

2018-04-15 · James Bevins, Rachel Slaybaugh

This paper introduces Gnowee, a modular, Python-based, open-source hybrid metaheuristic optimization algorithm (Available from https://github.com/SlaybaughLab/Gnowee). Gnowee is designed for rapid convergence to nearly g…

Metaheuristic Optimization

Deep Memory Search: A Metaheuristic Approach for Optimizing Heuristic Search

2024-10-22 · Abdel-Rahman Hedar, Alaa E. Abdel-Hakim, Wael Deabes, Youseef Alotaibi 외

Metaheuristic search methods have proven to be essential tools for tackling complex optimization challenges, but their full potential is often constrained by conventional algorithmic frameworks. In this paper, we introdu…

Heuristic SearchNavigate

GEGO: A Hybrid Golden Eagle and Genetic Optimization Algorithm for Efficient Hyperparameter Tuning in Resource-Constrained Environments

2026-01-21 · Amaras Nazarians, Sachin Kumar arxiv

Hyperparameter tuning is a critical yet computationally expensive step in training neural networks, particularly when the search space is high dimensional and nonconvex. Metaheuristic optimization algorithms are often us…

Hyperparameter Optimization