Causal Feature Selection with Dimension Reduction for Interpretable Text Classification

2020-10-09 · Guohou Shan, James Foulds, SHimei Pan

Text features that are correlated with class labels, but do not directly cause them, are sometimesuseful for prediction, but they may not be insightful. As an alternative to traditional correlation-basedfeature selection, causal inference could reveal more principled, meaningful relationships betweentext features and labels. To help researchers gain insight into text data, e.g. for social scienceapplications, in this paper we investigate a class of matching-based causal inference methods fortext feature selection. Features used in document classification are often high dimensional, howeverexisting causal feature selection methods use Propensity Score Matching (PSM) which is known to beless effective in high-dimensional spaces. We propose a new causal feature selection framework thatcombines dimension reduction with causal inference to improve text feature selection. Experiments onboth synthetic and real-world data demonstrate the promise of our methods in improving classificationand enhancing interpretability.

📄 PDF Abstract BibTeX arXiv:2010.04609

Code (0)

등록된 구현이 없습니다.

Tasks

Causal Inference Classification Dimensionality Reduction Document Classificationfeature selectionGeneral Classification text-classification Text Classification

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Causal inference Causal inference is the process of drawing a conclusion about a causal connection based on the conditions of the occurrence of an effect. The main difference between causal…

Selecting Robust Features for Machine Learning Applications using Multidata Causal Discovery

2023-04-11 · Saranya Ganesh S., Tom Beucler, Frederick Iat-Hin Tam, Milton S. Gomez 외

Robust feature selection is vital for creating reliable and interpretable Machine Learning (ML) models. When designing statistical prediction models in cases where domain knowledge is limited and underlying interactions …

Causal Discovery Dimensionality Reduction Explainable artificial intelligence feature selection+1

Interpretable Discriminative Dimensionality Reduction and Feature Selection on the Manifold

2019-09-19 · Babak Hosseini, Barbara Hammer

Dimensionality reduction (DR) on the manifold includes effective methods which project the data from an implicit relational space onto a vectorial space. Regardless of the achievements in this area, these algorithms suff…

Dimensionality Reduction feature selection

SparCA: Sparse Compressed Agglomeration for Feature Extraction and Dimensionality Reduction

2023-01-26 · Leland Barnard, Farwa Ali, Hugo Botha, David T. Jones

The most effective dimensionality reduction procedures produce interpretable features from the raw input space while also providing good performance for downstream supervised learning tasks. For many methods, this requir…

Dimensionality Reduction feature selection

Beyond Correlation: Causal Multi-View Unsupervised Feature Selection Learning

2025-09-17 · Zongxin Shen, Yanyong Huang, Bin Wang, Jinyuan Chang 외 arxiv

Multi-view unsupervised feature selection (MUFS) has recently received increasing attention for its promising ability in dimensionality reduction on multi-view unlabeled data. Existing MUFS methods typically select discr…

Dimensionality Reduction

Unsupervised Dimension Selection using a Blue Noise Spectrum

2018-10-31 · Jayaraman J. Thiagarajan, Rushil Anirudh, Rahul Sridhar, Peer-Timo Bremer

Unsupervised dimension selection is an important problem that seeks to reduce dimensionality of data, while preserving the most useful characteristics. While dimensionality reduction is commonly utilized to construct low…