Statistical Inference in Reinforcement Learning: A Selective Survey
Reinforcement learning (RL) is concerned with how intelligence agents take actions in a given environment to maximize the cumulative reward they receive. In healthcare, applying RL algorithms could assist patients in improving their health status. In ride-sharing platforms, applying RL algorithms could increase drivers' income and customer satisfaction. For large language models, applying RL algorithms could align their outputs with human preferences. Over the past decade, RL has been arguably one of the most vibrant research frontiers in machine learning. Nevertheless, statistics as a field, as opposed to computer science, has only recently begun to engage with RL both in depth and in breadth. This chapter presents a selective review of statistical inferential tools for RL, covering both hypothesis testing and confidence interval construction. Our goal is to highlight the value of statistical inference in RL for both the statistics and machine learning communities, and to promote the broader application of classical statistical inference tools in this vibrant area of research.
Code (1)
Tasks
reinforcement-learningReinforcement LearningReinforcement Learning (RL)SurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Recent Developments on Factor Models and its Applications in Econometric Learning
This paper makes a selective survey on the recent development of the factor model and its application on statistical learnings. We focus on the perspective of the low-rank structure of factor models, and particularly dra…
Matrix CompletionSurveyPenalized Likelihood Inference with Survey Data
This paper extends three Lasso inferential methods, Debiased Lasso, $C(\alpha)$ and Selective Inference to a survey environment. We establish the asymptotic validity of the inference procedures in generalized linear mode…
SurveySelective Inference Approach for Statistically Sound Predictive Pattern Mining
Discovering statistically significant patterns from databases is an important challenging problem. The main obstacle of this problem is in the difficulty of taking into account the selection bias, i.e., the bias arising …
Selection biasTwo-sample testingSelective Inference for Sparse High-Order Interaction Models
Finding statistically significant high-order interactions in predictive modeling is important but challenging task because the possible number of high-order interactions is extremely large (e.g., $> 10^{17}$). In th…
Drug Response Predictionfeature selectionVocal Bursts Intensity PredictionSelective inference using randomized group lasso estimators for general models
Selective inference methods are developed for group lasso estimators for use with a wide class of distributions and loss functions. The method includes the use of exponential family distributions, as well as quasi-likeli…
Nutrition