paper-with-me

홈 › Papers

Stochastic Optimization Algorithms for Instrumental Variable Regression with Streaming Data

2024-05-29 · Xuxing Chen, Abhishek Roy, Yifan Hu, Krishnakumar Balasubramanian

We develop and analyze algorithms for instrumental variable regression by viewing the problem as a conditional stochastic optimization problem. In the context of least-squares instrumental variable regression, our algorithms neither require matrix inversions nor mini-batches and provides a fully online approach for performing instrumental variable regression with streaming data. When the true model is linear, we derive rates of convergence in expectation, that are of order $\mathcal{O}(\log T/T)$ and $\mathcal{O}(1/T^{1-\iota})$ for any $\iota>0$, respectively under the availability of two-sample and one-sample oracles, respectively, where $T$ is the number of iterations. Importantly, under the availability of the two-sample oracle, our procedure avoids explicitly modeling and estimating the relationship between confounder and the instrumental variables, demonstrating the benefit of the proposed approach over recent works based on reformulating the problem as minimax optimization problems. Numerical experiments are provided to corroborate the theoretical results.

📄 PDF Abstract BibTeX arXiv:2405.19463

Code (0)

등록된 구현이 없습니다.

Tasks

regressionStochastic Optimization

Similar Papers 제목 키워드 기반

Dual Instrumental Variable Regression

2019-10-27 · NeurIPS 2020 12 · Krikamol Muandet, Arash Mehrjou, Si Kai Lee, Anant Raj

We present a novel algorithm for non-linear instrumental variable (IV) regression, DualIV, which simplifies traditional two-stage methods via a dual formulation. Inspired by problems in stochastic programming, we show th…

regression

Differentially Private Two-Stage Gradient Descent for Instrumental Variable Regression

2025-09-26 · Haodong Liang, Yanhao Jin, Krishnakumar Balasubramanian, Lifeng Lai arxiv

We study instrumental variable regression (IVaR) under differential privacy constraints. Classical IVaR methods (like two-stage least squares regression) rely on solving moment equations that directly use sensitive covar…

Non-Asymptotic State-Space Identification of Closed-Loop Stochastic Linear Systems using Instrumental Variables

2023-01-29 · Szabolcs Szentpéteri, Balázs Csanád Csáji

The paper suggests a generalization of the Sign-Perturbed Sums (SPS) finite sample system identification method for the identification of closed-loop observable stochastic linear systems in state-space form. The solution…

Stochastic Online Instrumental Variable Regression: Regrets for Endogeneity and Bandit Feedback

2023-02-18 · Riccardo Della Vecchia, Debabrota Basu

Endogeneity, i.e. the dependence of noise and covariates, is a common phenomenon in real data due to omitted variables, strategic behaviours, measurement errors etc. In contrast, the existing analyses of stochastic onlin…

Causal Inferenceregression

Decentralization Estimators for Instrumental Variable Quantile Regression Models

2020-09-16

The instrumental variable quantile regression (IVQR) model (Chernozhukov and Hansen, 2005) is a popular tool for estimating causal quantile effects with endogenous covariates. However, estimation is complicated by the no…

quantile regressionregression