paper-with-me

홈 › Papers

Demographic Inference and Representative Population Estimates from Multilingual Social Media Data

2019-05-15 · Zijian Wang, Scott A. Hale, David Adelani, Przemyslaw A. Grabowicz, Timo Hartmann, Fabian Flöck, David Jurgens

Social media provide access to behavioural data at an unprecedented scale and granularity. However, using these data to understand phenomena in a broader population is difficult due to their non-representativeness and the bias of statistical inference tools towards dominant languages and groups. While demographic attribute inference could be used to mitigate such bias, current techniques are almost entirely monolingual and fail to work in a global environment. We address these challenges by combining multilingual demographic inference with post-stratification to create a more representative population sample. To learn demographic attributes, we create a new multimodal deep neural architecture for joint classification of age, gender, and organization-status of social media users that operates in 32 languages. This method substantially outperforms current state of the art while also reducing algorithmic bias. To correct for sampling biases, we propose fully interpretable multilevel regression methods that estimate inclusion probabilities from inferred joint population counts and ground-truth population counts. In a large experiment over multilingual heterogeneous European regions, we show that our demographic inference and bias correction together allow for more accurate estimates of populations and make a significant step towards representative social sensing in downstream applications with multilingual social media.

📄 PDF Abstract BibTeX arXiv:1905.05961

Code (0)

등록된 구현이 없습니다.

Tasks

Attribute

Similar Papers 제목 키워드 기반

Mental Health Surveillance over Social Media with Digital Cohorts

2019-06-01 · WS 2019 6 · Silvio Amir, Mark Dredze, John W. Ayers

The ability to track mental health conditions via social media opened the doors for large-scale, automated, mental health surveillance. However, inferring accurate population-level trends requires representative samples …

Correcting Sociodemographic Selection Biases for Population Prediction from Social Media

2019-11-10 · Salvatore Giorgi, Veronica Lynn, Keshav Gupta, Farhan Ahmed 외

Social media is increasingly used for large-scale population predictions, such as estimating community health statistics. However, social media users are not typically a representative sample of the intended population -…

PredictionSelection bias

Assessing Generalization for Subpopulation Representative Modeling via In-Context Learning

2024-02-12 · Gabriel Simmons, Vladislav Savinov

This study evaluates the ability of Large Language Model (LLM)-based Subpopulation Representative Models (SRMs) to generalize from empirical data, utilizing in-context learning with data from the 2016 and 2020 American N…

In-Context LearningLanguage ModelingLanguage ModellingLarge Language Model

Mapping Languages and Demographics with Georeferenced Corpora

2020-04-02 · Jonathan Dunn, Ben Adams

This paper evaluates large georeferenced corpora, taken from both web-crawled and social media sources, against ground-truth population and language-census datasets. The goal is to determine (i) which dataset best repres…

PopResume: Causal Fairness Evaluation of LLM/VLM Resume Screeners with Population-Representative Dataset

2026-03-24 · Sumin Yu, Juhyeon Park, Taesup Moon arxiv

We present PopResume, a population-representative resume dataset for causal fairness auditing of LLM- and VLM-based resume screening systems. Unlike existing benchmarks that rely on manually injected demographic informat…