paper-with-me

Papers

Online Data Collection for Efficient Semiparametric Inference

2024-11-05 · Shantanu Gupta, Zachary C. Lipton, David Childers

While many works have studied statistical data fusion, they typically assume that the various datasets are given in advance. However, in practice, estimation requires difficult data collection decisions like determining the available data sources, their costs, and how many samples to collect from each source. Moreover, this process is often sequential because the data collected at a given time can improve collection decisions in the future. In our setup, given access to multiple data sources and budget constraints, the agent must sequentially decide which data source to query to efficiently estimate a target parameter. We formalize this task using Online Moment Selection, a semiparametric framework that applies to any parameter identified by a set of moment conditions. Interestingly, the optimal budget allocation depends on the (unknown) true parameters. We present two online data collection policies, Explore-then-Commit and Explore-then-Greedy, that use the parameter estimates at a given time to optimally allocate the remaining budget in the future steps. We prove that both policies achieve zero regret (assessed by asymptotic MSE) relative to an oracle policy. We empirically validate our methods on both synthetic and real-world causal effect estimation tasks, demonstrating that the online data collection policies outperform their fixed counterparts.

📄 PDF Abstract BibTeX arXiv:2411.03195

Code (1)

shantanu95/online-moment-selection 공식 구현

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Efficient Inference after Directionally Stable Adaptive Experiments

2026-02-25 · Zikai Shen, Houssam Zenati, Nathan Kallus, Arthur Gretton 외 arxiv

We study inference on scalar-valued pathwise differentiable targets after adaptive data collection, such as a bandit algorithm. We introduce a novel target-specific condition, directional stability, which is strictly wea…

LLM Evaluation as Tensor Completion: Low Rank Structure and Semiparametric Efficiency

2026-04-07 · Jiachun Li, David Simchi-Levi, Will Wei Sun arxiv

Large language model (LLM) evaluation platforms increasingly rely on pairwise human judgments. These data are noisy, sparse, and non-uniform, yet leaderboards are reported with limited uncertainty quantification. We stud…

Deep Neural Networks for Estimation and Inference

2018-09-26 · Max H. Farrell, Tengyuan Liang, Sanjog Misra

We study deep neural networks and their use in semiparametric inference. We establish novel rates of convergence for deep feedforward neural nets. Our new rates are sufficiently fast (in some cases minimax optimal) to al…

Marketingregressionvalid

Semiparametric inference for partially linear regressions with Box-Cox transformation

2021-06-20 · Daniel Becker, Alois Kneip, Valentin Patilea

In this paper, a semiparametric partially linear model in the spirit of Robinson (1988) with Box- Cox transformed dependent variable is studied. Transformation regression models are widely used in applied econometrics to…

Econometrics

Penalized GMM Framework for Inference on Functionals of Nonparametric Instrumental Variable Estimators

2026-03-31 · Edvard Bakhitov arxiv

This paper develops a penalized GMM (PGMM) framework for automatic debiased inference on functionals of nonparametric instrumental variable estimators. We derive convergence rates for the PGMM estimator and provide condi…