paper-with-me

Papers

CAVIAR: Categorical-Variable Embeddings for Accurate and Robust Inference

2024-04-07 · Anirban Mukherjee, Hannah Hanwen Chang

Social science research often hinges on the relationship between categorical variables and outcomes. We introduce CAVIAR, a novel method for embedding categorical variables that assume values in a high-dimensional ambient space but are sampled from an underlying manifold. Our theoretical and numerical analyses outline challenges posed by such categorical variables in causal inference. Specifically, dynamically varying and sparse levels can lead to violations of the Donsker conditions and a failure of the estimation functionals to converge to a tight Gaussian process. Traditional approaches, including the exclusion of rare categorical levels and principled variable selection models like LASSO, fall short. CAVIAR embeds the data into a lower-dimensional global coordinate system. The mapping can be derived from both structured and unstructured data, and ensures stable and robust estimates through dimensionality reduction. In a dataset of direct-to-consumer apparel sales, we illustrate how high-dimensional categorical variables, such as zip codes, can be succinctly represented, facilitating inference and analysis.

📄 PDF Abstract BibTeX arXiv:2404.04979

Code (0)

등록된 구현이 없습니다.

Tasks

Causal InferenceDimensionality ReductionVariable Selection

Similar Papers 제목 키워드 기반

Adaptive Random Bandwidth for Inference in CAViaR Models

2021-02-02 · Alain Hecq, Li Sun

This paper investigates the size performance of Wald tests for CAViaR models (Engle and Manganelli, 2004). We find that the usual estimation strategy on test statistics yields inaccuracies. Indeed, we show that existing …

Density Estimation

Entity Embeddings of Categorical Variables

2016-04-22 · Cheng Guo, Felix Berkhahn

We map categorical variables in a function approximation problem into Euclidean spaces, which are the entity embeddings of the categorical variables. The mapping is learned by a neural network during the standard supervi…

ClusteringEntity Embeddings

Probabilistic Hash Embeddings for Online Learning of Categorical Features

2025-11-25 · Aodong Li, Abishek Sankararaman, Balakrishnan Narayanaswamy arxiv

We study streaming data with categorical features where the vocabulary of categorical feature values is changing and can even grow unboundedly over time. Feature hashing is commonly used as a pre-processing step to map t…

Recommendation Systems

ptype-cat: Inferring the Type and Values of Categorical Variables

2021-11-23 · Taha Ceritli, Christopher K. I. Williams

Type inference is the task of identifying the type of values in a data column and has been studied extensively in the literature. Most existing type inference methods support data types such as Boolean, date, float, inte…

Vocal Bursts Type Prediction

Implementing NLPs in industrial process modeling: Addressing Categorical Variables

2024-09-27 · Eleni D. Koronaki, Geremy Loachamin Suntaxi, Paris Papavasileiou, Dimitrios G. Giovanis 외

Important variables of processes are often categorical, i.e. names or labels representing, e.g. categories of inputs, or types of reactors or a sequence of steps. In this work, we use Natural Language Processing Models t…

Dimensionality ReductionFeature Importance