paper-with-me

Papers

Error bounds for maxout neural network approximations of model predictive control

2023-04-18 · Dieter Teichrib, Moritz Schulze Darup

Neural network (NN) approximations of model predictive control (MPC) are a versatile approach if the online solution of the underlying optimal control problem (OCP) is too demanding and if an exact computation of the explicit MPC law is intractable. The drawback of such approximations is that they typically do not preserve stability and performance guarantees of the original MPC. However, such guarantees can be recovered if the maximum error with respect to the optimal control law and the Lipschitz constant of that error are known. We show in this work how to compute both values exactly when the control law is approximated by a maxout NN. We build upon related results for ReLU NN approximations and derive mixed-integer (MI) linear constraints that allow a computation of the output and the local gain of a maxout NN by solving an MI feasibility problem. Furthermore, we show theoretically and experimentally that maxout NN exist for which the maximum error is zero.

📄 PDF Abstract BibTeX arXiv:2304.08779

Code (0)

등록된 구현이 없습니다.

Tasks

Model Predictive Control

Methods 이 논문이 사용한 방법론

Maxout The Maxout Unit is a generalization of the ReLU and the leaky ReLU functions. It is a…

Similar Papers 제목 키워드 기반

Random Maxout Features

2015-06-11 · Youssef Mroueh, Steven Rennie, Vaibhava Goel

In this paper, we propose and study random maxout features, which are constructed by first projecting the input data onto sets of randomly generated vectors with Gaussian elements, and then outputing the maximum projecti…

Data VisualizationDimensionality ReductionGeneral ClassificationGeneralization Bounds

Sharp bounds for the number of regions of maxout networks and vertices of Minkowski sums

2021-04-16 · Guido Montúfar, Yue Ren, Leon Zhang

We present results on the number of linear regions of the functions that can be represented by artificial feedforward neural networks with maxout units. A rank-k maxout unit is a function computing the maximum of $k$ lin…

How Good are Low-Rank Approximations in Gaussian Process Regression?

2020-04-03 · Constantinos Daskalakis, Petros Dellaportas, Aristeidis Panos

We provide guarantees for approximate Gaussian Process (GP) regression resulting from two common low-rank kernel approximations: based on random Fourier features, and based on truncating the kernel's Mercer expansion. In…

Gaussian Processesregression

How Good are Low-Rank Approximations in Gaussian Process Regression?

2021-12-13 · Constantinos Daskalakis, Petros Dellaportas, Aristeidis Panos

We provide guarantees for approximate Gaussian Process (GP) regression resulting from two common low-rank kernel approximations: based on random Fourier features, and based on truncating the kernel's Mercer expansion. In…

regression

Expected Gradients of Maxout Networks and Consequences to Parameter Initialization

2023-01-17 · Hanna Tseran, Guido Montúfar

We study the gradients of a maxout network with respect to inputs and parameters and obtain bounds for the moments depending on the architecture and the parameter distribution. We observe that the distribution of the inp…