A Subspace-based Approach for Dimensionality Reduction and Important Variable Selection
An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few important features, but they are limited due to the lack of interpretability and connectivity to actual decision making associated with each physical variable. Variable selection techniques, as an alternative, can maintain the interpretability, but they often involve a greedy search that is susceptible to failure in capturing important interactions or a metaheuristic search that requires extensive computations. This research proposes a new method that produces subspaces, reduced-dimensional physical spaces, based on a randomized search and leverages an ensemble of critical subspace-based models, achieving dimensionality reduction and variable selection. When applied to high-dimensional data collected from the failure prediction of a composite/metal hybrid structure exhibiting complex progressive damage failure under loading, the proposed method outperforms the existing and potential alternatives in prediction and important variable selection.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingDimensionality ReductionVariable SelectionSimilar Papers 제목 키워드 기반
Hyperspectral Image Analysis with Subspace Learning-based One-Class Classification
Hyperspectral image (HSI) classification is an important task in many applications, such as environmental monitoring, medical imaging, and land use/land cover (LULC) classification. Due to the significant amount of spect…
ClassificationDimensionality Reductionfeature selectionHyperspectral image analysis+1Linear Tensor Projection Revealing Nonlinearity
Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as princi…
Dimensionality ReductionPredictionTowards Making High Dimensional Distance Metric Learning Practical
In this work, we study distance metric learning (DML) for high dimensional data. A typical approach for DML with high dimensional data is to perform the dimensionality reduction first before learning the distance metric.…
Dimensionality ReductionMetric LearningVocal Bursts Intensity PredictionHigh Dimensional Bayesian Optimization using Lasso Variable Selection
Bayesian optimization (BO) is a leading method for optimizing expensive black-box optimization and has been successfully applied across various scenarios. However, BO suffers from the curse of dimensionality, making it c…
Bayesian OptimizationComputational EfficiencyVariable SelectionFeature selection in functional data classification with recursive maxima hunting
Dimensionality reduction is one of the key issues in the design of effective machine learning methods for automatic induction. In this work, we introduce recursive maxima hunting (RMH) for variable selection in classific…
Dimensionality Reductionfeature selectionGeneral ClassificationVariable Selection