Estimating Transfer Entropy via Copula Entropy
Causal discovery is a fundamental problem in statistics and has wide applications in different fields. Transfer Entropy (TE) is a important notion defined for measuring causality, which is essentially conditional Mutual Information (MI). Copula Entropy (CE) is a theory on measurement of statistical independence and is equivalent to MI. In this paper, we prove that TE can be represented with only CE and then propose a non-parametric method for estimating TE via CE. The proposed method was applied to analyze the Beijing PM2.5 data in the experiments. Experimental results show that the proposed method can infer causality relationships from data effectively and hence help to understand the data better.
Code (3)
Tasks
Causal DiscoveryCausal InferenceSimilar Papers 제목 키워드 기반
copent: Estimating Copula Entropy and Transfer Entropy in R
Statistical independence and conditional independence are two fundamental concepts in statistics and machine learning. Copula Entropy is a mathematical concept defined by Ma and Sun for multivariate statistical independe…
BIG-bench Machine LearningCausal DiscoveryMutual Information Estimationstatistical independence testing+1Identifying Time Lag in Dynamical Systems with Copula Entropy based Transfer Entropy
Time lag between variables is a key characteristics of dynamical systems in different fields and identifying such time lag is an important problem in complex systems with many applications. Transfer Entropy (TE) was prop…
MIND: Inductive Mutual Information Estimation, A Convex Maximum-Entropy Copula Approach
We propose a novel estimator of the mutual information between two ordinal vectors $x$ and $y$. Our approach is inductive (as opposed to deductive) in that it depends on the data generating distribution solely through so…
Mutual Information EstimationDependence Structure Estimation via Copula
Dependence strucuture estimation is one of the important problems in machine learning domain and has many applications in different scientific areas. In this paper, a theoretical framework for such estimation based on co…
Discovering Association with Copula Entropy
Discovering associations is of central importance in scientific practices. Currently, most researches consider only linear association measured by correlation coefficient, which has its theoretical limitations. In this p…