paper-with-me

Papers

Representing Piecewise Linear Functions by Functions with Small Arity

2023-05-26 · Christoph Koutschan, Bernhard Moser, Anton Ponomarchuk, Josef Schicho

A piecewise linear function can be described in different forms: as an arbitrarily nested expression of $\min$- and $\max$-functions, as a difference of two convex piecewise linear functions, or as a linear combination of maxima of affine-linear functions. In this paper, we provide two main results: first, we show that for every piecewise linear function there exists a linear combination of $\max$-functions with at most $n+1$ arguments, and give an algorithm for its computation. Moreover, these arguments are contained in the finite set of affine-linear functions that coincide with the given function in some open set. Second, we prove that the piecewise linear function $\max(0, x_{1}, \ldots, x_{n})$ cannot be represented as a linear combination of maxima of less than $n+1$ affine-linear arguments. This was conjectured by Wang and Sun in 2005 in a paper on representations of piecewise linear functions as linear combination of maxima.

📄 PDF Abstract BibTeX arXiv:2305.16933

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Representing Piecewise-Linear Functions by Functions with Minimal Arity

2024-06-04 · Christoph Koutschan, Anton Ponomarchuk, Josef Schicho

Any continuous piecewise-linear function $F\colon \mathbb{R}^{n}\to \mathbb{R}$ can be represented as a linear combination of $\max$ functions of at most $n+1$ affine-linear functions. In our previous paper [``Representi…

Expression of Fractals Through Neural Network Functions

2019-05-27 · Nadav Dym, Barak Sober, Ingrid Daubechies

To help understand the underlying mechanisms of neural networks (NNs), several groups have, in recent years, studied the number of linear regions $\ell$ of piecewise linear functions generated by deep neural networks (DN…

Formalizing Piecewise Affine Activation Functions of Neural Networks in Coq

2023-01-30 · Andrei Aleksandrov, Kim Völlinger

Verification of neural networks relies on activation functions being piecewise affine (pwa) -- enabling an encoding of the verification problem for theorem provers. In this paper, we present the first formalization of pw…

Notes on stable learning with piecewise-linear basis functions

2018-04-25 · Winfried Lohmiller, Philipp Gassert, Jean-Jacques Slotine

We discuss technical results on learning function approximations using piecewise-linear basis functions, and analyze their stability and convergence using nonlinear contraction theory.

Piecewise Polynomial Regression of Tame Functions via Integer Programming

2023-11-22 · Gilles Bareilles, Johannes Aspman, Jiri Nemecek, Jakub Marecek

Tame functions are a class of nonsmooth, nonconvex functions, which feature in a wide range of applications: functions encountered in the training of deep neural networks with all common activations, value functions of m…

regression