Provable Variable Selection for Streaming Features
In large-scale machine learning applications and high-dimensional statistics, it is ubiquitous to address a considerable number of features among which many are redundant. As a remedy, online feature selection has attracted increasing attention in recent years. It sequentially reveals features and evaluates the importance of them. Though online feature selection has proven an elegant methodology, it is usually challenging to carry out a rigorous theoretical characterization. In this work, we propose a provable online feature selection algorithm that utilizes the online leverage score. The selected features are then fed to $k$-means clustering, making the clustering step memory and computationally efficient. We prove that with high probability, performing $k$-means clustering based on the selected feature space does not deviate far from the optimal clustering using the original data. The empirical results on real-world data sets demonstrate the effectiveness of our algorithm.
Code (0)
등록된 구현이 없습니다.
Tasks
Clusteringfeature selectionVariable SelectionSimilar Papers 제목 키워드 기반
An Online Sparse Streaming Feature Selection Algorithm
Online streaming feature selection (OSFS), which conducts feature selection in an online manner, plays an important role in dealing with high-dimensional data. In many real applications such as intelligent healthcare pla…
feature selectionOnline Sparse Streaming Feature Selection Using Adapted Classification
Traditional feature selections need to know the feature space before learning, and online streaming feature selection (OSFS) is proposed to process streaming features on the fly. Existing methods divide features into rel…
ClassificationFeature Correlationfeature selectionFairness-Aware Streaming Feature Selection with Causal Graphs
Its crux lies in the optimization of a tradeoff between accuracy and fairness of resultant models on the selected feature subset. The technical challenge of our setting is twofold: 1) streaming feature inputs, such that …
FairnessFeature Correlationfeature selectionSemi-Supervised Deep Sobolev Regression: Estimation and Variable Selection by ReQU Neural Network
We propose SDORE, a Semi-supervised Deep Sobolev Regressor, for the nonparametric estimation of the underlying regression function and its gradient. SDORE employs deep ReQU neural networks to minimize the empirical risk …
regressionVariable SelectionVariable Selection via Thompson Sampling
Thompson sampling is a heuristic algorithm for the multi-armed bandit problem which has a long tradition in machine learning. The algorithm has a Bayesian spirit in the sense that it selects arms based on posterior sampl…
BIG-bench Machine LearningInterpretable Machine LearningStochastic OptimizationThompson Sampling+1