Beam Search for Feature Selection
In this paper, we present and prove some consistency results about the performance of classification models using a subset of features. In addition, we propose to use beam search to perform feature selection, which can be viewed as a generalization of forward selection. We apply beam search to both simulated and real-world data, by evaluating and comparing the performance of different classification models using different sets of features. The results demonstrate that beam search could outperform forward selection, especially when the features are correlated so that they have more discriminative power when considered jointly than individually. Moreover, in some cases classification models could obtain comparable performance using only ten features selected by beam search instead of hundreds of original features.
Code (0)
등록된 구현이 없습니다.
Tasks
Classificationfeature selectionSimilar Papers 제목 키워드 기반
Causal Beam Selection for Reliable Initial Access in AI-driven Beam Management
Efficient and reliable beam alignment is a critical requirement for mmWave multiple-input multiple-output (MIMO) systems, especially in 6G and beyond, where communication must be fast, adaptive, and resilient to real-wor…
Beam PredictionLIDAR and Position-Aided mmWave Beam Selection with Non-local CNNs and Curriculum Training
Efficient millimeter wave (mmWave) beam selection in vehicle-to-infrastructure (V2I) communication is a crucial yet challenging task due to the narrow mmWave beamwidth and high user mobility. To reduce the search overhea…
Knowledge DistillationPositionMore Test-Time Compute Can Hurt: Overestimation Bias in LLM Beam Search
Wider beam search should improve LLM reasoning, but when should you stop widening? Prior work on beam width selection has focused on inference efficiency \citep{qin2025dsbd, freitag2017beam}, without analyzing whether wi…
gBeam-ACO: a greedy and faster variant of Beam-ACO
Beam-ACO, a modification of the traditional Ant Colony Optimization (ACO) algorithms that incorporates a modified beam search, is one of the most effective ACO algorithms for solving the Traveling Salesman Problem (TSP).…
Heuristic SearchTraveling Salesman ProblemDeep Learning on Multimodal Sensor Data at the Wireless Edge for Vehicular Network
Beam selection for millimeter-wave links in a vehicular scenario is a challenging problem, as an exhaustive search among all candidate beam pairs cannot be assuredly completed within short contact times. We solve this pr…
Edge-computing