paper-with-me

홈 › Papers

Variable Selection with Copula Entropy

2019-10-28 · Jian Ma

Variable selection is of significant importance for classification and regression tasks in machine learning and statistical applications where both predictability and explainability are needed. In this paper, a Copula Entropy (CE) based method for variable selection which use CE based ranks to select variables is proposed. The method is both model-free and tuning-free. Comparison experiments between the proposed method and traditional variable selection methods, such as Distance Correlation, Hilbert-Schmidt Independence Criterion, Stepwise Selection, regularized generalized linear models and Adaptive LASSO, were conducted on the UCI heart disease data. Experimental results show that CE based method can select the `right' variables out more effectively and derive better interpretable results than traditional methods do without sacrificing accuracy performance. It is believed that CE based variable selection can help to build more explainable models.

📄 PDF Abstract BibTeX arXiv:1910.12389

Code (1)

majianthu/aps2020 공식 구현

Tasks

Explainable ModelsFeature ImportanceVariable Selection

Similar Papers 제목 키워드 기반

copent: Estimating Copula Entropy and Transfer Entropy in R

2020-05-27 · Jian Ma

Statistical independence and conditional independence are two fundamental concepts in statistics and machine learning. Copula Entropy is a mathematical concept defined by Ma and Sun for multivariate statistical independe…

BIG-bench Machine LearningCausal DiscoveryMutual Information Estimationstatistical independence testing+1

Copula Entropy based Variable Selection for Survival Analysis

2022-09-04 · Jian Ma

Variable selection is an important problem in statistics and machine learning. Copula Entropy (CE) is a mathematical concept for measuring statistical independence and has been applied to variable selection recently. In …

Survival AnalysisVariable Selection

System Identification with Copula Entropy

2023-04-23 · Jian Ma

Identifying differential equation governing dynamical system is an important problem with wide applications. Copula Entropy (CE) is a mathematical concept for measuring statistical independence in information theory. In …

Variable Selection

Facies Classification with Copula Entropy

2025-01-24 · Jian Ma

In this paper we propose to apply copula entropy (CE) to facies classification. In our method, the correlations between geological variables and facies classes are measured with CE and then the variables associated with …

ClassificationFacies Classification

Speedy Model Selection (SMS) for Copula Models

2013-09-26 · Yaniv Tenzer, Gal Elidan

We tackle the challenge of efficiently learning the structure of expressive multivariate real-valued densities of copula graphical models. We start by theoretically substantiating the conjecture that for many copula fami…

modelModel Selection