Sparsity-based Feature Selection for Anomalous Subgroup Discovery
Anomalous pattern detection aims to identify instances where deviation from normalcy is evident, and is widely applicable across domains. Multiple anomalous detection techniques have been proposed in the state of the art. However, there is a common lack of a principled and scalable feature selection method for efficient discovery. Existing feature selection techniques are often conducted by optimizing the performance of prediction outcomes rather than its systemic deviations from the expected. In this paper, we proposed a sparsity-based automated feature selection (SAFS) framework, which encodes systemic outcome deviations via the sparsity of feature-driven odds ratios. SAFS is a model-agnostic approach with usability across different discovery techniques. SAFS achieves more than $3\times$ reduction in computation time while maintaining detection performance when validated on publicly available critical care dataset. SAFS also results in a superior performance when compared against multiple baselines for feature selection.
Code (0)
등록된 구현이 없습니다.
Tasks
feature selectionSubgroup DiscoveryMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Model-free feature selection to facilitate automatic discovery of divergent subgroups in tabular data
Data-centric AI encourages the need of cleaning and understanding of data in order to achieve trustworthy AI. Existing technologies, such as AutoML, make it easier to design and train models automatically, but there is a…
AutoMLfeature selectionPost-discovery Analysis of Anomalous Subsets
Analyzing the behaviour of a population in response to disease and interventions is critical to unearth variability in healthcare as well as understand sub-populations that require specialized attention, but also to assi…
Preservation of Anomalous Subgroups On Machine Learning Transformed Data
In this paper, we investigate the effect of machine learning based anonymization on anomalous subgroup preservation. In particular, we train a binary classifier to discover the most anomalous subgroup in a dataset by max…
BIG-bench Machine LearningSubgroup DiscoverySpectral Discovery of Continuous Symmetries via Generalized Fourier Transforms
Continuous symmetries are fundamental to many scientific and learning problems, yet they are often unknown a priori. Existing symmetry discovery approaches typically search directly in the space of transformation generat…
Symmetry DetectionUsing Constraints to Discover Sparse and Alternative Subgroup Descriptions
Subgroup-discovery methods allow users to obtain simple descriptions of interesting regions in a dataset. Using constraints in subgroup discovery can enhance interpretability even further. In this article, we focus on tw…
Binary ClassificationHeuristic SearchSubgroup Discovery