paper-with-me

Papers

On Uniform Weighted Deep Polynomial approximation

2025-06-26 · Kingsley Yeon, Steven B. Damelin

It is a classical result in rational approximation theory that certain non-smooth or singular functions, such as $|x|$ and $x^{1/p}$, can be efficiently approximated using rational functions with root-exponential convergence in terms of degrees of freedom \cite{Sta, GN}. In contrast, polynomial approximations admit only algebraic convergence by Jackson's theorem \cite{Lub2}. Recent work shows that composite polynomial architectures can recover exponential approximation rates even without smoothness \cite{KY}. In this work, we introduce and analyze a class of weighted deep polynomial approximants tailored for functions with asymmetric behavior-growing unbounded on one side and decaying on the other. By multiplying a learnable deep polynomial with a one-sided weight, we capture both local non-smoothness and global growth. We show numerically that this framework outperforms Taylor, Chebyshev, and standard deep polynomial approximants, even when all use the same number of parameters. To optimize these approximants in practice, we propose a stable graph-based parameterization strategy building on \cite{Jar}.

📄 PDF Abstract BibTeX arXiv:2506.21306

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Universal approximation results for neural networks with non-polynomial activation function over non-compact domains

2024-10-18 · Ariel Neufeld, Philipp Schmocker

This paper extends the universal approximation property of single-hidden-layer feedforward neural networks beyond compact domains, which is of particular interest for the approximation within weighted $C^k$-spaces and we…

A Tight Analysis of Greedy Yields Subexponential Time Approximation for Uniform Decision Tree

2019-06-26 · Ray Li, Percy Liang, Stephen Mussmann

Decision Tree is a classic formulation of active learning: given $n$ hypotheses with nonnegative weights summing to 1 and a set of tests that each partition the hypotheses, output a decision tree using the provided tests…

Active Learning

Uniform $\mathcal{C}^k$ Approximation of $G$-Invariant and Antisymmetric Functions, Embedding Dimensions, and Polynomial Representations

2024-03-02 · Soumya Ganguly, Khoa Tran, Rahul Sarkar

For any subgroup $G$ of the symmetric group $\mathcal{S}_n$ on $n$ symbols, we present results for the uniform $\mathcal{C}^k$ approximation of $G$-invariant functions by $G$-invariant polynomials. For the case of totall…

Approximation speed of quantized vs. unquantized ReLU neural networks and beyond

2022-05-24 · Antoine Gonon, Nicolas Brisebarre, Rémi Gribonval, Elisa Riccietti

We deal with two complementary questions about approximation properties of ReLU networks. First, we study how the uniform quantization of ReLU networks with real-valued weights impacts their approximation properties. We …

Quantization

Optimized Layerwise Approximation for Efficient Private Inference on Fully Homomorphic Encryption

2023-10-16 · Junghyun Lee, Eunsang Lee, Young-Sik Kim, Yongwoo Lee 외

Recent studies have explored the deployment of privacy-preserving deep neural networks utilizing homomorphic encryption (HE), especially for private inference (PI). Many works have attempted the approximation-aware train…

Privacy Preserving