paper-with-me

홈 › Papers

Kernel-based off-policy estimation without overlap: Instance optimality beyond semiparametric efficiency

2023-01-16 · Wenlong Mou, Peng Ding, Martin J. Wainwright, Peter L. Bartlett

We study optimal procedures for estimating a linear functional based on observational data. In many problems of this kind, a widely used assumption is strict overlap, i.e., uniform boundedness of the importance ratio, which measures how well the observational data covers the directions of interest. When it is violated, the classical semi-parametric efficiency bound can easily become infinite, so that the instance-optimal risk depends on the function class used to model the regression function. For any convex and symmetric function class $\mathcal{F}$, we derive a non-asymptotic local minimax bound on the mean-squared error in estimating a broad class of linear functionals. This lower bound refines the classical semi-parametric one, and makes connections to moduli of continuity in functional estimation. When $\mathcal{F}$ is a reproducing kernel Hilbert space, we prove that this lower bound can be achieved up to a constant factor by analyzing a computationally simple regression estimator. We apply our general results to various families of examples, thereby uncovering a spectrum of rates that interpolate between the classical theories of semi-parametric efficiency (with $\sqrt{n}$-consistency) and the slower minimax rates associated with non-parametric function estimation.

📄 PDF Abstract BibTeX arXiv:2301.06240

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Characterization of Overlap in Observational Studies

2019-07-09 · Michael Oberst, Fredrik D. Johansson, Dennis Wei, Tian Gao 외

Overlap between treatment groups is required for non-parametric estimation of causal effects. If a subgroup of subjects always receives the same intervention, we cannot estimate the effect of intervention changes on that…

Binary Classification

Efficient Domain-Adaptive Policy Learning via Kernel Representation with Application to Quadrotor Control under Non-Stationary Disturbances

2026-06-11 · Hongyu Zhou, Mingtian Tan, Vasileios Tzoumas arxiv

We present an algorithm for efficient domain-adaptive policy learning via kernel representations. Learning domain-adaptive policies is challenging since it requires an environment representation that is both sufficiently…

Accountable Off-Policy Evaluation via a Kernelized Bellman Statistics

2020-01-01 · ICML 2020 1 · Yihao Feng, Tongzheng Ren, Ziyang Tang, Qiang Liu

Off-policy evaluation plays an important role in modern reinforcement learning. However, most of the existing off-policy evaluation only focus on the value estimation, without providing an accountable confidence interval…

Off-policy evaluation

Overlapping Cover Local Regression Machines

2017-01-05 · Mohamed Elhoseiny, Ahmed Elgammal

We present the Overlapping Domain Cover (ODC) notion for kernel machines, as a set of overlapping subsets of the data that covers the entire training set and optimized to be spatially cohesive as possible. We show how th…

Gaussian ProcessesGPRPose Estimationregression

Uncovering Causality from Multivariate Hawkes Integrated Cumulants

2016-07-21 · ICML 2017 8 · Massil Achab, Emmanuel Bacry, Stéphane Gaïffas, Iacopo Mastromatteo 외

We design a new nonparametric method that allows one to estimate the matrix of integrated kernels of a multivariate Hawkes process. This matrix not only encodes the mutual influences of each nodes of the process, but als…