Causal Feature Selection via Orthogonal Search
The problem of inferring the direct causal parents of a response variable among a large set of explanatory variables is of high practical importance in many disciplines. However, established approaches often scale at least exponentially with the number of explanatory variables, are difficult to extend to nonlinear relationships, and are difficult to extend to cyclic data. Inspired by {\em Debiased} machine learning methods, we study a one-vs.-the-rest feature selection approach to discover the direct causal parent of the response. We propose an algorithm that works for purely observational data while also offering theoretical guarantees, including the case of partially nonlinear relationships possibly under the presence of cycles. As it requires only one estimation for each variable, our approach is applicable even to large graphs. We demonstrate significant improvements compared to established approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal Discoveryfeature selectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Causality-based Feature Selection: Methods and Evaluations
Feature selection is a crucial preprocessing step in data analytics and machine learning. Classical feature selection algorithms select features based on the correlations between predictive features and the class variabl…
feature selectionEmbedded Multi-label Feature Selection via Orthogonal Regression
In the last decade, embedded multi-label feature selection methods, incorporating the search for feature subsets into model optimization, have attracted considerable attention in accurately evaluating the importance of f…
feature selectionModel OptimizationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+1A Unified View of Causal and Non-causal Feature Selection
In this paper, we aim to develop a unified view of causal and non-causal feature selection methods. The unified view will fill in the gap in the research of the relation between the two types of methods. Based on the Bay…
Attributefeature selectionOrthogonality-Constrained Deep Instrumental Variable Model for Causal Effect Estimation
OC-DeepIV is a neural network model designed for estimating causal effects. It characterizes heterogeneity by adding interaction features and reduces redundancy through orthogonal constraints. The model includes two feat…
Block Variable Selection in Multivariate Regression and High-dimensional Causal Inference
We consider multivariate regression problems involving high-dimensional predictor and response spaces. To efficiently address such problems, we propose a variable selection method, Multivariate Group Orthogonal Matching …
Causal InferenceregressionTime SeriesTime Series Analysis+2