paper-with-me

홈 › Papers

Tree-Guided Rare Feature Selection and Logic Aggregation with Electronic Health Records Data

2022-06-18 · Jianmin Chen, Robert H. Aseltine, Fei Wang, Kun Chen

Statistical learning with a large number of rare binary features is commonly encountered in analyzing electronic health records (EHR) data, especially in the modeling of disease onset with prior medical diagnoses and procedures. Dealing with the resulting highly sparse and large-scale binary feature matrix is notoriously challenging as conventional methods may suffer from a lack of power in testing and inconsistency in model fitting while machine learning methods may suffer from the inability of producing interpretable results or clinically-meaningful risk factors. To improve EHR-based modeling and utilize the natural hierarchical structure of disease classification, we propose a tree-guided feature selection and logic aggregation approach for large-scale regression with rare binary features, in which dimension reduction is achieved through not only a sparsity pursuit but also an aggregation promoter with the logic operator of ``or''. We convert the combinatorial problem into a convex linearly-constrained regularized estimation, which enables scalable computation with theoretical guarantees. In a suicide risk study with EHR data, our approach is able to select and aggregate prior mental health diagnoses as guided by the diagnosis hierarchy of the International Classification of Diseases. By balancing the rarity and specificity of the EHR diagnosis records, our strategy improves both prediction and model interpretation. We identify important higher-level categories and subcategories of mental health conditions and simultaneously determine the level of specificity needed for each of them in predicting suicide risk.

📄 PDF Abstract BibTeX arXiv:2206.09107

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality Reductionfeature selectionSpecificity

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Topologically-Guided Color Image Enhancement

2019-09-03 · Junyi Tu, Paul Rosen

Enhancement is an important step in post-processing digital images for personal use, in medical imaging, and for object recognition. Most existing manual techniques rely on region selection, similarity, and/or thresholdi…

Image EnhancementObject Recognition

LLM-FS: Zero-Shot Feature Selection for Effective and Interpretable Malware Detection

2026-02-10 · Naveen Gill, Ajvad Haneef K, Madhu Kumar S D arxiv

Feature selection (FS) remains essential for building accurate and interpretable detection models, particularly in high-dimensional malware datasets. Conventional FS methods such as Extra Trees, Variance Threshold, Tree-…

Malware Detection

Guided Random Forest in the RRF Package

2013-06-02 · Houtao Deng

Random Forest (RF) is a powerful supervised learner and has been popularly used in many applications such as bioinformatics. In this work we propose the guided random forest (GRF) for feature selection. Similar to a fe…

feature selection

Rare Feature Selection in High Dimensions

2018-03-18 · Xiaohan Yan, Jacob Bien

It is common in modern prediction problems for many predictor variables to be counts of rarely occurring events. This leads to design matrices in which many columns are highly sparse. The challenge posed by such "rare fe…

feature selectionVocal Bursts Intensity Prediction

When Rule Violations Are Rare: Chimera Training for Logical Anomaly Detection

2026-05-25 · Alejandro Ascarate, Leo Lebrat, Rodrigo Santa Cruz, Clinton Fookes 외 arxiv

Many practical anomalies are not merely rare inputs, but violations of semantic constraints: objects co-occur in structured ways, actions imply preconditions, and events satisfy temporal or relational regularities. We st…

Anomaly Detection