paper-with-me

홈 › Papers

A general framework for implementing distances for categorical variables

2023-01-04 · Michel van de Velden, Alfonso Iodice D'Enza, Angelos Markos, Carlo Cavicchia

The degree to which subjects differ from each other with respect to certain properties measured by a set of variables, plays an important role in many statistical methods. For example, classification, clustering, and data visualization methods all require a quantification of differences in the observed values. We can refer to the quantification of such differences, as distance. An appropriate definition of a distance depends on the nature of the data and the problem at hand. For distances between numerical variables, there exist many definitions that depend on the size of the observed differences. For categorical data, the definition of a distance is more complex, as there is no straightforward quantification of the size of the observed differences. Consequently, many proposals exist that can be used to measure differences based on categorical variables. In this paper, we introduce a general framework that allows for an efficient and transparent implementation of distances between observations on categorical variables. We show that several existing distances can be incorporated into the framework. Moreover, our framework quite naturally leads to the introduction of new distance formulations and allows for the implementation of flexible, case and data specific distance definitions. Furthermore, in a supervised classification setting, the framework can be used to construct distances that incorporate the association between the response and predictor variables and hence improve the performance of distance-based classifiers.

📄 PDF Abstract BibTeX arXiv:2301.02190

Code (1)

alfonsoiodicede/catdist_package 공식 구현

Tasks

Data Visualization

Similar Papers 제목 키워드 기반

Implementing NLPs in industrial process modeling: Addressing Categorical Variables

2024-09-27 · Eleni D. Koronaki, Geremy Loachamin Suntaxi, Paris Papavasileiou, Dimitrios G. Giovanis 외

Important variables of processes are often categorical, i.e. names or labels representing, e.g. categories of inputs, or types of reactors or a sequence of steps. In this work, we use Natural Language Processing Models t…

Dimensionality ReductionFeature Importance

Non-parametric Conditional Independence Testing for Mixed Continuous-Categorical Variables: A Novel Method and Numerical Evaluation

2023-10-17 · Oana-Iuliana Popescu, Andreas Gerhardus, Jakob Runge

Conditional independence testing (CIT) is a common task in machine learning, e.g., for variable selection, and a main component of constraint-based causal discovery. While most current CIT approaches assume that all vari…

Causal DiscoveryVariable Selection

NLP Based Anomaly Detection for Categorical Time Series

2022-04-22 · Matthew Horak, Sowmya Chandrasekaran, Giovanni Tobar

Identifying anomalies in large multi-dimensional time series is a crucial and difficult task across multiple domains. Few methods exist in the literature that address this task when some of the variables are categorical …

Anomaly DetectionTime SeriesTime Series Analysis

MURAL: An Unsupervised Random Forest-Based Embedding for Electronic Health Record Data

2021-11-19 · Michal Gerasimiuk, Dennis Shung, Alexander Tong, Adrian Stanley 외

A major challenge in embedding or visualizing clinical patient data is the heterogeneity of variable types including continuous lab values, categorical diagnostic codes, as well as missing or incomplete data. In particul…

DiagnosticDimensionality Reduction

Exploiting Categorical Structure Using Tree-Based Methods

2020-04-15 · Brian Lucena

Standard methods of using categorical variables as predictors either endow them with an ordinal structure or assume they have no structure at all. However, categorical variables often possess structure that is more compl…