paper-with-me

Papers

Adaptive Linear Estimating Equations

2023-07-14 · NeurIPS 2023 11 · Mufang Ying, Koulik Khamaru, Cun-Hui Zhang

Sequential data collection has emerged as a widely adopted technique for enhancing the efficiency of data gathering processes. Despite its advantages, such data collection mechanism often introduces complexities to the statistical inference procedure. For instance, the ordinary least squares (OLS) estimator in an adaptive linear regression model can exhibit non-normal asymptotic behavior, posing challenges for accurate inference and interpretation. In this paper, we propose a general method for constructing debiased estimator which remedies this issue. It makes use of the idea of adaptive linear estimating equations, and we establish theoretical guarantees of asymptotic normality, supplemented by discussions on achieving near-optimal asymptotic variance. A salient feature of our estimator is that in the context of multi-armed bandits, our estimator retains the non-asymptotic performance of the least square estimator while obtaining asymptotic normality property. Consequently, this work helps connect two fruitful paradigms of adaptive inference: a) non-asymptotic inference using concentration inequalities and b) asymptotic inference via asymptotic normality.

📄 PDF Abstract BibTeX arXiv:2307.07320

Code (1)

mufangying/alee 공식 구현

Tasks

Multi-Armed Bandits

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Semi-parametric inference based on adaptively collected data

2023-03-05 · Licong Lin, Koulik Khamaru, Martin J. Wainwright

Many standard estimators, when applied to adaptively collected data, fail to be asymptotically normal, thereby complicating the construction of confidence intervals. We address this challenge in a semi-parametric context…

Learning Controlled Stochastic Differential Equations

2024-11-04 · Luc Brogat-Motte, Riccardo Bonalli, Alessandro Rudi

Identification of nonlinear dynamical systems is crucial across various fields, facilitating tasks such as control, prediction, optimization, and fault detection. Many applications require methods capable of handling com…

Fault Detection

Longitudinal data analysis using generalized linear models

1986-04-01 · Biometrika 1986 4 · KUNG-YEE LIANG, Scott L. Zeger

This paper proposes an extension of generalized linear models to the analysis of longitudinal data. We introduce a class of estimating equations that give consistent estimates of the regression parameters and of their va…

Causal InferenceParameter Predictionregression

Coupling parameter and particle dynamics for adaptive sampling in Neural Galerkin schemes

2023-06-27 · Yuxiao Wen, Eric Vanden-Eijnden, Benjamin Peherstorfer

Training nonlinear parametrizations such as deep neural networks to numerically approximate solutions of partial differential equations is often based on minimizing a loss that includes the residual, which is analyticall…

For Solving Linear Equations Recombination is a Needless Operation in Time-Variant Adaptive Hybrid Algorithms

2013-04-09 · A. R. M. Jalal Uddin Jamali, Mohammad Arif Hossain, G. M. Moniruzzaman, M. M. A. Hashem

Recently hybrid evolutionary computation (EC) techniques are successfully implemented for solving large sets of linear equations. All the recently developed hybrid evolutionary algorithms, for solving linear equations, c…

Evolutionary Algorithms