paper-with-me

홈 › Papers

Statistical Inference in Reinforcement Learning: A Selective Survey

2025-02-22 · Chengchun Shi

Reinforcement learning (RL) is concerned with how intelligence agents take actions in a given environment to maximize the cumulative reward they receive. In healthcare, applying RL algorithms could assist patients in improving their health status. In ride-sharing platforms, applying RL algorithms could increase drivers' income and customer satisfaction. For large language models, applying RL algorithms could align their outputs with human preferences. Over the past decade, RL has been arguably one of the most vibrant research frontiers in machine learning. Nevertheless, statistics as a field, as opposed to computer science, has only recently begun to engage with RL both in depth and in breadth. This chapter presents a selective review of statistical inferential tools for RL, covering both hypothesis testing and confidence interval construction. Our goal is to highlight the value of statistical inference in RL for both the statistics and machine learning communities, and to promote the broader application of classical statistical inference tools in this vibrant area of research.

📄 PDF Abstract BibTeX arXiv:2502.16195

Code (1)

yunzhe-zhou/markov_test 공식 구현 tf

Tasks

reinforcement-learningReinforcement LearningReinforcement Learning (RL)Survey

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Recent Developments on Factor Models and its Applications in Econometric Learning

2020-09-21 · Jianqing Fan, Kunpeng Li, Yuan Liao

This paper makes a selective survey on the recent development of the factor model and its application on statistical learnings. We focus on the perspective of the low-rank structure of factor models, and particularly dra…

Matrix CompletionSurvey

Penalized Likelihood Inference with Survey Data

2023-04-16 · Joann Jasiak, Purevdorj Tuvaandorj

This paper extends three Lasso inferential methods, Debiased Lasso, $C(\alpha)$ and Selective Inference to a survey environment. We establish the asymptotic validity of the inference procedures in generalized linear mode…

Survey

Selective Inference Approach for Statistically Sound Predictive Pattern Mining

2016-02-15 · Shinya Suzumura, Kazuya Nakagawa, Mahito Sugiyama, Koji Tsuda 외

Discovering statistically significant patterns from databases is an important challenging problem. The main obstacle of this problem is in the difficulty of taking into account the selection bias, i.e., the bias arising …

Selection biasTwo-sample testing

Selective Inference for Sparse High-Order Interaction Models

2017-08-01 · ICML 2017 8 · Shinya Suzumura, Kazuya Nakagawa, Yuta Umezu, Koji Tsuda 외

Finding statistically significant high-order interactions in predictive modeling is important but challenging task because the possible number of high-order interactions is extremely large (e.g., $> 10^{17}$). In th…

Drug Response Predictionfeature selectionVocal Bursts Intensity Prediction

Selective inference using randomized group lasso estimators for general models

2023-06-24 · Yiling Huang, Sarah Pirenne, Snigdha Panigrahi, Gerda Claeskens

Selective inference methods are developed for group lasso estimators for use with a wide class of distributions and loss functions. The method includes the use of exponential family distributions, as well as quasi-likeli…

Nutrition