Semantic Scaling: Bayesian Ideal Point Estimates with Large Language Models
This paper introduces "Semantic Scaling," a novel method for ideal point estimation from text. I leverage large language models to classify documents based on their expressed stances and extract survey-like data. I then use item response theory to scale subjects from these data. Semantic Scaling significantly improves on existing text-based scaling methods, and allows researchers to explicitly define the ideological dimensions they measure. This represents the first scaling approach that allows such flexibility outside of survey instruments and opens new avenues of inquiry for populations difficult to survey. Additionally, it works with documents of varying length, and produces valid estimates of both mass and elite ideology. I demonstrate that the method can differentiate between policy preferences and in-group/out-group affect. Among the public, Semantic Scaling out-preforms Tweetscores according to human judgement; in Congress, it recaptures the first dimension DW-NOMINATE while allowing for greater flexibility in resolving construct validity challenges.
Code (0)
등록된 구현이 없습니다.
Tasks
SurveyvalidSimilar Papers 제목 키워드 기반
py-irt: A Scalable Item Response Theory Library for Python
py-irt is a Python library for fitting Bayesian Item Response Theory (IRT) models. py-irt estimates latent traits of subjects and items, making it appropriate for use in IRT tasks as well as ideal-point models. py-irt is…
GPUExpressive yet Tractable Bayesian Deep Learning via Subnetwork Inference
The Bayesian paradigm has the potential to solve some of the core issues in modern deep learning, such as poor calibration, data inefficiency, and catastrophic forgetting. However, scaling Bayesian inference to the high-…
Bayesian InferenceDeep LearningSPARC: Single-Pass Scaling for Motion Forecasting with Conformal Bayesian Last Layers
Human motion forecasters are increasingly accurate and fast, but reliable deployment requires uncertainty estimates that are structured, calibrated, and efficient. Bayesian and ensemble-based uncertainty estimates often …
Motion ForecastingBayesian Image Super-Resolution with Deep Modeling of Image Statistics
Modeling statistics of image priors is useful for image super-resolution, but little attention has been paid from the massive works of deep learning-based methods. In this work, we propose a Bayesian image restoration fr…
Image RestorationImage Super-ResolutionSuper-ResolutionVariational Refinement for Importance SamplingUsing the Forward Kullback-Leibler Divergence
Variational Inference (VI) is a popular alternative to asymptotically exact sampling in Bayesian inference. Its main workhorse is optimization over a reverse Kullback-Leibler divergence (RKL), which typically underestim…
Bayesian InferenceVariational Inference