paper-with-me

홈 › Papers

A Unifying Framework for Robust and Efficient Inference with Unstructured Data

2025-05-01 · Jacob Carlson, Melissa Dell

This paper presents a general framework for conducting efficient and robust inference on parameters derived from unstructured data, which include text, images, audio, and video. Economists have long incorporated data extracted from texts and images into their analyses, a practice that has accelerated with advancements in deep neural networks. However, neural networks do not generically produce unbiased predictions, potentially propagating bias to estimators that use their outputs. To address this challenge, we reframe inference with unstructured data as a missing structured data problem, where structured data are imputed from unstructured inputs using deep neural networks. This perspective allows us to apply classic results from semiparametric inference, yielding valid, efficient, and robust estimators based on unstructured data. We formalize this approach with MARS (Missing At Random Structured Data), a unifying framework that integrates and extends existing methods for debiased inference using machine learning predictions, linking them to a variety of older, familiar problems such as causal inference. We develop robust and efficient estimators for both descriptive and causal estimands and address challenges such as inference using aggregated and transformed predictions from unstructured data. Importantly, MARS applies to common empirical settings that have received limited attention in the existing literature. Finally, we reanalyze prominent studies that use unstructured data, demonstrating the practical value of MARS.

📄 PDF Abstract BibTeX arXiv:2505.00282

Code (0)

등록된 구현이 없습니다.

Tasks

Causal InferenceDescriptive

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

KG-GPT: A General Framework for Reasoning on Knowledge Graphs Using Large Language Models

2023-10-17 · Jiho Kim, Yeonsu Kwon, Yohan Jo, Edward Choi

While large language models (LLMs) have made considerable advancements in understanding and generating unstructured text, their application in structured data remains underexplored. Particularly, using LLMs for complex r…

Fact VerificationKnowledge GraphsRetrievalSentence+1

Unifying Generative Models with GFlowNets and Beyond

2022-09-06 · Dinghuai Zhang, Ricky T. Q. Chen, Nikolay Malkin, Yoshua Bengio

There are many frameworks for deep generative modeling, each often presented with their own specific training algorithms and inference methods. Here, we demonstrate the connections between existing deep generative models…

Decision Making

TRIALSCOPE: A Unifying Causal Framework for Scaling Real-World Evidence Generation with Biomedical Language Models

2023-11-02 · Javier González, Cliff Wong, Zelalem Gero, Jass Bagga 외

The rapid digitization of real-world data offers an unprecedented opportunity for optimizing healthcare delivery and accelerating biomedical discovery. In practice, however, such data is most abundantly available in unst…

Causal InferenceDenoisingImputation

VQA-GNN: Reasoning with Multimodal Knowledge via Graph Neural Networks for Visual Question Answering

2022-05-23 · ICCV 2023 1 · Yanan Wang, Michihiro Yasunaga, Hongyu Ren, Shinya Wada 외

Visual question answering (VQA) requires systems to perform concept-level reasoning by unifying unstructured (e.g., the context in question and answer; "QA context") and structured (e.g., knowledge graph for the QA conte…

Knowledge GraphsQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Integrating Unstructured Text into Causal Inference: Empirical Evidence from Real Data

2026-02-15 · Boning Zhou, Ziyu Wang, Han Hong, Haoqi Hu arxiv

Causal inference, a critical tool for informing business decisions, traditionally relies heavily on structured data. However, in many real-world scenarios, such data can be incomplete or unavailable. This paper presents …

Causal Inference