Causal Inference on Outcomes Learned from Text
We propose a machine-learning tool that yields causal inference on text in randomized trials. Based on a simple econometric framework in which text may capture outcomes of interest, our procedure addresses three questions: First, is the text affected by the treatment? Second, which outcomes is the effect on? And third, how complete is our description of causal effects? To answer all three questions, our approach uses large language models (LLMs) that suggest systematic differences across two groups of text documents and then provides valid inference based on costly validation. Specifically, we highlight the need for sample splitting to allow for statistical validation of LLM outputs, as well as the need for human labeling to validate substantive claims about how documents differ across groups. We illustrate the tool in a proof-of-concept application using abstracts of academic manuscripts.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal InferencevalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Federated Estimation of Causal Effects from Observational Data
Many modern applications collect data that comes in federated spirit, with data kept locally and undisclosed. Till date, most insight into the causal inference requires data to be stored in a central repository. We prese…
Causal InferenceGaussian ProcessesBeauty Learning and Counterfactual Inference
This work showcases a new approach for causal discovery by leveraging user experiments and recent advances in photo-realistic image editing, demonstrating a potential of identifying causal factors and understanding compl…
Causal DiscoveryCausal InferencecounterfactualCounterfactual InferenceCausal Inference with Unstructured Outcomes
Causal inference has traditionally centered on scalar outcomes: whether a patient recovers, how much a worker earns, or how many visits a website receives. Modern studies increasingly ask causal questions about outcomes …
Causal InferenceCausal Inference for Sequential Settings under Interference and Latent Confounding
We study causal inference under outcome interference for sequential, observational settings. Specifically, we consider settings where the binary outcomes over N units are Markovian across T time steps. At each time step,…
Causal InferenceCausal Inference for Qualitative Outcomes
Causal inference methods such as instrumental variables, regression discontinuity, and difference-in-differences are widely used to estimate treatment effects. However, their application to qualitative outcomes poses fun…
Causal Inference