paper-with-me

홈 › Papers

Controlling for Unobserved Confounds in Classification Using Correlational Constraints

2017-03-05 · Virgile Landeiro, Aron Culotta

As statistical classifiers become integrated into real-world applications, it is important to consider not only their accuracy but also their robustness to changes in the data distribution. In this paper, we consider the case where there is an unobserved confounding variable $z$ that influences both the features $\mathbf{x}$ and the class variable $y$. When the influence of $z$ changes from training to testing data, we find that the classifier accuracy can degrade rapidly. In our approach, we assume that we can predict the value of $z$ at training time with some error. The prediction for $z$ is then fed to Pearl's back-door adjustment to build our model. Because of the attenuation bias caused by measurement error in $z$, standard approaches to controlling for $z$ are ineffective. In response, we propose a method to properly control for the influence of $z$ by first estimating its relationship with the class variable $y$, then updating predictions for $z$ to match that estimated relationship. By adjusting the influence of $z$, we show that we can build a model that exceeds competing baselines on accuracy as well as on robustness over a range of confounding relationships.

📄 PDF Abstract BibTeX arXiv:1703.01671

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral Classification

Similar Papers 제목 키워드 기반

Confounds and Overestimations in Fake Review Detection: Experimentally Controlling for Product-Ownership and Data-Origin

2021-10-28 · Felix Soldner, Bennett Kleinberg, Shane Johnson

The popularity of online shopping is steadily increasing. At the same time, fake product reviewsare published widely and have the potential to affect consumer purchasing behavior. In response,previous work has developed …

Deconfounded Lexicon Induction for Interpretable Social Science

2018-06-01 · NAACL 2018 6 · Reid Pryzant, Kelly Shen, Dan Jurafsky, Stefan Wagner

NLP algorithms are increasingly used in computational social science to take linguistic observations and predict outcomes like human preferences or actions. Making these social models transparent and interpretable often …

Disambiguatory Signals are Stronger in Word-initial Positions

2021-02-03 · EACL 2021 2 · Tiago Pimentel, Ryan Cotterell, Brian Roark

Psycholinguistic studies of human word processing and lexical access provide ample evidence of the preferred nature of word-initial versus word-final segments, e.g., in terms of attention paid by listeners (greater) or t…

Informativeness

Do LLM Embedding Spaces Recover Expert Structure?

2026-06-22 · Yixuan Zhu, Zhenke Duan, Fanghen Li arxiv

Pretrained text embeddings are increasingly used as representational maps, yet high category separability does not imply that their geometry recovers expert-defined structure. We study this problem in mental-health-relat…

Fairness Through Causal Awareness: Learning Latent-Variable Models for Biased Data

2018-09-07 · David Madras, Elliot Creager, Toniann Pitassi, Richard Zemel

How do we learn from biased data? Historical datasets often reflect historical prejudices; sensitive or protected attributes may affect the observed treatments and outcomes. Classification algorithms tasked with predicti…

AttributeFairnessGeneral Classification