Hybrid methodology based on Bayesian optimization and GA-PARSIMONY to search for parsimony models by combining hyperparameter optimization and feature selection
This article presents a hybrid methodology that combines Bayesian optimization (BO) with a constrained version of the GA-PARSIMONY method to obtain parsimony models. The proposal is designed to reduce the sizeable computational effort associated with the use of GA-PARSIMONY alone. The method begins with BO to obtain favorable initial model parameters. Then, with these parameters, a constrained GA-PARSIMONY is implemented to generate accurate parsimony models by using feature reduction, data transformation and parsimonious model selection. Experiments with extreme gradient boosting machines (XGBoost) and ten UCI databases demonstrated that the hybrid methodology obtains models analogous to those of GA-PARSIMONY while achieving significant reductions in elapsed time in eight out of ten datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian Optimizationfeature selectionHyperparameter OptimizationModel SelectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HYB-PARSIMONY: A hybrid approach combining Particle Swarm Optimization and Genetic Algorithms to find parsimonious models in high-dimensional datasets
The PSO-PARSIMONY methodology (a heuristic for finding accurate and low-complexity models with particle swarm optimization (PSO)) allows obtaining machine learning models with a good balance between accuracy and complexi…
PSO-PARSIMONY: A method for finding parsimonious and accurate machine learning models with particle swarm optimization. Application for predicting force–displacement curves in T-stub steel connections
We present PSO-PARSIMONY, a new methodology to search for parsimonious and highly accurate models by means of particle swarm optimization. PSO-PARSIMONY uses automatic hyperparameter optimization and feature selection to…
feature selectionHyperparameter OptimizationImproving hotel room demand forecasting with a hybrid GA-SVR methodology based on skewed data transformation, feature selection and parsimony tuning
This article presents a hybrid methodology in which a KDD scheme is optimized to build accurate parsimonious models. The methodology tries to find the best model by using genetic algorithms to optimize a KDD scheme forme…
Demand Forecastingfeature selectionModel SelectionParsimony-Enhanced Sparse Bayesian Learning for Robust Discovery of Partial Differential Equations
Robust physics discovery is of great interest for many scientific and engineering fields. Inspired by the principle that a representative model is the one simplest possible, a new model selection criteria considering bot…
Bayesian InferenceModel SelectionSearching parsimonious solutions with GA-PARSIMONY and XGboost in high-dimensional databases
EXtreme Gradient Boosting (XGBoost) has become one of the most successful techniques in machine learning competitions. It is computationally efficient and scalable, it supports a wide variety of objective functions and i…
feature selectionModel Selection