Feature Selection with Distance Correlation
Choosing which properties of the data to use as input to multivariate decision algorithms -- a.k.a. feature selection -- is an important step in solving any problem with machine learning. While there is a clear trend towards training sophisticated deep networks on large numbers of relatively unprocessed inputs (so-called automated feature engineering), for many tasks in physics, sets of theoretically well-motivated and well-understood features already exist. Working with such features can bring many benefits, including greater interpretability, reduced training and run time, and enhanced stability and robustness. We develop a new feature selection method based on Distance Correlation (DisCo), and demonstrate its effectiveness on the tasks of boosted top- and $W$-tagging. Using our method to select features from a set of over 7,000 energy flow polynomials, we show that we can match the performance of much deeper architectures, by using only ten features and two orders-of-magnitude fewer model parameters.
Code (0)
등록된 구현이 없습니다.
Tasks
Automated Feature EngineeringFeature Engineeringfeature selectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Feature Selection Based on Wasserstein Distance
This paper presents a novel feature selection method leveraging the Wasserstein distance to improve feature selection in machine learning. Unlike traditional methods based on correlation or Kullback-Leibler (KL) divergen…
feature selectionDistance Correlation Sure Independence Screening for Accelerated Feature Selection in Parkinson's Disease Vocal Data
With the abundance of machine learning methods available and the temptation of using them all in an ensemble method, having a model-agnostic method of feature selection is incredibly alluring. Principal component analysi…
feature selectionDistance Rank Score: Unsupervised filter method for feature selection on imbalanced dataset
This paper presents a new filter method for unsupervised feature selection. This method is particularly effective on imbalanced multi-class dataset, as in case of clusters of different anomaly types. Existing methods usu…
Clusteringfeature selectionInteraction pursuit in high-dimensional multi-response regression via distance correlation
Feature interactions can contribute to a large proportion of variation in many prediction models. In the era of big data, the coexistence of high dimensionality in both responses and covariates poses unprecedented challe…
feature selectionregressionVocal Bursts Intensity PredictionDISCOMAX: A Proximity-Preserving Distance Correlation Maximization Algorithm
In a regression setting we propose algorithms that reduce the dimensionality of the features while simultaneously maximizing a statistical measure of dependence known as distance correlation between the low-dimensional f…
regression