Causality-Based Feature Importance Quantifying Methods: PN-FI, PS-FI and PNS-FI
In the current ML field models are getting larger and more complex, and data used for model training are also getting larger in quantity and higher in dimensions. Therefore, in order to train better models, and save training time and computational resources, a good Feature Selection (FS) method in the preprocessing stage is necessary. Feature importance (FI) is of great importance since it is the basis of feature selection. Therefore, this paper creatively introduces the calculation of PN (the probability of Necessity), PN (the probability of Sufficiency), and PNS (the probability of Necessity and Sufficiency) of Causality into quantifying feature importance and creates 3 new FI measuring methods, PN-FI, which means how much importance a feature has in image recognition tasks, PS-FI that means how much importance a feature has in image generating tasks, and PNS-FI which measures both. The main body of this paper is three RCTs, with whose results we show how PS-FI, PN-FI, and PNS-FI of 3 features, dog nose, dog eyes, and dog mouth are calculated. The experiments show that firstly, FI values are intervals with tight upper and lower bounds. Secondly, the feature dog eyes has the most importance while the other two have almost the same. Thirdly, the bounds of PNS and PN are tighter than the bounds of PS.
Code (0)
등록된 구현이 없습니다.
Tasks
Feature Importancefeature selectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CAGE: Causality-Aware Shapley Value for Global Explanations
As Artificial Intelligence (AI) is having more influence on our everyday lives, it becomes important that AI-based decisions are transparent and explainable. As a consequence, the field of eXplainable AI (or XAI) has bec…
Feature ImportanceWhat we write about when we write about causality: Features of causal statements across large-scale social discourse
Identifying and communicating relationships between causes and effects is important for understanding our world, but is affected by language structure, cognitive and emotional biases, and the properties of the communicat…
Sentiment AnalysisTopic ModelsAn information-theoretic quantification of the content of communication between brain regions
Quantifying the amount, content and direction of communication between brain regions is key to understanding brain function. Traditional methods to analyze brain activity based on the Wiener-Granger causality principle q…
Linear and nonlinear causality in financial markets
Identifying and quantifying co-dependence between financial instruments is a key challenge for researchers and practitioners in the financial industry. Linear measures such as the Pearson correlation are still widely use…
Causal InferenceManagementPAIR TRADINGCan Transfer Entropy Infer Information Flow in Neuronal Circuits for Cognitive Processing?
To infer information flow in any network of agents, it is important first and foremost to establish causal temporal relations between the nodes. Practical and automated methods that can infer causality are difficult to f…
Motion DetectionTime Series Analysis