paper-with-me

Papers

Nonparametric adaptive control and prediction: theory and randomized algorithms

2021-06-07 · Nicholas M. Boffi, Stephen Tu, Jean-Jacques E. Slotine

A key assumption in the theory of nonlinear adaptive control is that the uncertainty of the system can be expressed in the linear span of a set of known basis functions. While this assumption leads to efficient algorithms, it limits applications to very specific classes of systems. We introduce a novel nonparametric adaptive algorithm that estimates an infinite-dimensional density over parameters online to learn an unknown dynamics in a reproducing kernel Hilbert space. Surprisingly, the resulting control input admits an analytical expression that enables its implementation despite its underlying infinite-dimensional structure. While this adaptive input is rich and expressive - subsuming, for example, traditional linear parameterizations - its computational complexity grows linearly with time, making it comparatively more expensive than its parametric counterparts. Leveraging the theory of random Fourier features, we provide an efficient randomized implementation that recovers the complexity of classical parametric methods while provably retaining the expressivity of the nonparametric input. In particular, our explicit bounds only depend polynomially on the underlying parameters of the system, allowing our proposed algorithms to efficiently scale to high-dimensional systems. As an illustration of the method, we demonstrate the ability of the randomized approximation algorithm to learn a predictive model of a 60-dimensional system consisting of ten point masses interacting through Newtonian gravitation. By reinterpretation as a gradient flow on a specific loss, we conclude with a natural extension of our kernel-based adaptive algorithms to deep neural networks. We show empirically that the extra expressivity afforded by deep representations can lead to improved performance at the expense of closed-loop stability that is rigorously guaranteed and consistently observed for kernel machines.

📄 PDF Abstract BibTeX arXiv:2106.03589

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction

Similar Papers 제목 키워드 기반

Adaptive Randomized Smoothing: Certified Adversarial Robustness for Multi-Step Defences

2024-06-14 · Saiyue Lyu, Shadab Shaikh, Frederick Shpilevskiy, Evan Shelhamer 외

We propose Adaptive Randomized Smoothing (ARS) to certify the predictions of our test-time adaptive models against adversarial examples. ARS extends the analysis of randomized smoothing using $f$-Differential Privacy to …

Adversarial Robustnessimage-classificationImage Classification

Learning-based Adaptive Control using Contraction Theory

2021-03-04 · Hiroyasu Tsukamoto, Soon-Jo Chung, Jean-Jacques Slotine

Adaptive control is subject to stability and performance issues when a learned model is used to enhance its performance. This paper thus presents a deep learning-based adaptive control framework for nonlinear systems wit…

A nonparametric sequential test for online randomized experiments

2016-10-08 · Vineet Abhishek, Shie Mannor

We propose a nonparametric sequential test that aims to address two practical problems pertinent to online randomized experiments: (i) how to do a hypothesis test for complex metrics; (ii) how to prevent type $1$ error i…

Lazily Adapted Constant Kinky Inference for Nonparametric Regression and Model-Reference Adaptive Control

2016-12-31 · Jan-Peter Calliess

Techniques known as Nonlinear Set Membership prediction, Lipschitz Interpolation or Kinky Inference are approaches to machine learning that utilise presupposed Lipschitz properties to compute inferences over unobserved f…

BIG-bench Machine LearningGaussian Processesregression

Kernel Truncated Randomized Ridge Regression: Optimal Rates and Low Noise Acceleration

2019-05-25 · NeurIPS 2019 12 · Kwang-Sung Jun, Ashok Cutkosky, Francesco Orabona

In this paper, we consider the nonparametric least square regression in a Reproducing Kernel Hilbert Space (RKHS). We propose a new randomized algorithm that has optimal generalization error bounds with respect to the sq…

regression