Beyond Noise: A Hypothesis Testing Approach to Robust Feature Selection
Feature selection remains difficult in modern high-dimensional settings, and established methods such as Boruta and Recursive Feature Elimination are either computationally costly or lack a statistically justified stopping criterion for their importance scores. A common heuristic adds random noise features and retains any predictor ranking above the strongest one, but this rule is purely ad hoc. We introduce a method that keeps the noise-augmentation idea while grounding it in theory: each feature's importance is tested against the maximum noise importance using a non-parametric bootstrap hypothesis test, with statistical derivations supporting the algorithm's design. On controlled simulations, the method recovers true signal more consistently than Boruta and Knockoff-based procedures; on diverse real-world datasets, it outperforms Boruta, RFE, and Extra Trees. The result is a robust, principled selector that yields reliable inference, improved prediction, and efficient computation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Testing hypotheses via orthogonalization
Classical hypothesis testing frameworks break down in contemporary settings in which null hypotheses are increasingly abstract, the same data are used to both generate and test hypotheses, and minimal assumptions about t…
ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing
Evaluating outputs of large language models (LLMs) is challenging, requiring making -- and making sense of -- many responses. Yet tools that go beyond basic prompting tend to require knowledge of programming APIs, focus …
Model SelectionPrompt EngineeringText GenerationBeyond Class-Conditional Assumption: A Primary Attempt to Combat Instance-Dependent Label Noise
Supervised learning under label noise has seen numerous advances recently, while existing theoretical findings and empirical results broadly build up on the class-conditional noise (CCN) assumption that the noise is inde…
Image ClassificationGeneralized Likelihood Ratio Test for Adversarially Robust Hypothesis Testing
Machine learning models are known to be susceptible to adversarial attacks which can cause misclassification by introducing small but well designed perturbations. In this paper, we consider a classical hypothesis testing…
Anchor-based Maximum Discrepancy for Relative Similarity Testing
The relative similarity testing aims to determine which of the distributions, P or Q, is closer to an anchor distribution U. Existing kernel-based approaches often test the relative similarity with a fixed kernel in a ma…