Parameter Selection Algorithm For Continuous Variables
In this article, we propose a new algorithm for supervised learning methods, by which one can both capture the non-linearity in data and also find the best subset model. To produce an enhanced subset of the original variables, an ideal selection method should have the potential of adding a supplementary level of regression analysis that would capture complex relationships in the data via mathematical transformation of the predictors and exploration of synergistic effects of combined variables. The method that we present here has the potential to produce an optimal subset of variables, rendering the overall process of model selection to be more efficient. The core objective of this paper is to introduce a new estimation technique for the classical least square regression framework. This new automatic variable transformation and model selection method could offer an optimal and stable model that minimizes the mean square error and variability, while combining all possible subset selection methodology and including variable transformations and interaction. Moreover, this novel method controls multicollinearity, leading to an optimal set of explanatory variables.
Code (0)
등록된 구현이 없습니다.
Tasks
Model SelectionregressionSimilar Papers 제목 키워드 기반
Combining Linear Non-Gaussian Acyclic Model with Logistic Regression Model for Estimating Causal Structure from Mixed Continuous and Discrete Data
Estimating causal models from observational data is a crucial task in data analysis. For continuous-valued data, Shimizu et al. have proposed a linear acyclic non-Gaussian model to understand the data generating process,…
Causal DiscoveryModel SelectionImproving Group Lasso for high-dimensional categorical data
Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known e…
Model SelectionVocal Bursts Intensity PredictionScalable Variational Bayesian Kernel Selection for Sparse Gaussian Process Regression
This paper presents a variational Bayesian kernel selection (VBKS) algorithm for sparse Gaussian process regression (SGPR) models. In contrast to existing GP kernel selection algorithms that aim to select only one kernel…
regressionStochastic OptimizationVariational InferenceBayesian Optimization for Categorical and Category-Specific Continuous Inputs
Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propos…
Bayesian OptimizationBIG-bench Machine LearningThompson SamplingGryffin: An algorithm for Bayesian optimization of categorical variables informed by expert knowledge
Designing functional molecules and advanced materials requires complex design choices: tuning continuous process parameters such as temperatures or flow rates, while simultaneously selecting catalysts or solvents. To dat…
Bayesian OptimizationDensity Estimation