Harmonic Decompositions of Convolutional Networks
We present a description of the function space and the smoothness class associated with a convolutional network using the machinery of reproducing kernel Hilbert spaces. We show that the mapping associated with a convolutional network expands into a sum involving elementary functions akin to spherical harmonics. This functional decomposition can be related to the functional ANOVA decomposition in nonparametric statistics. Building off our functional characterization of convolutional networks, we obtain statistical bounds highlighting an interesting trade-off between the approximation error and the estimation error.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Automatic Construction Of Robust Spherical Harmonic Subspaces
In this paper we propose a method to automatically recover a class specific low dimensional spherical harmonic basis from a set of in-the-wild facial images. We combine existing techniques for uncalibrated photometric st…
Harmonic Convolutional Networks based on Discrete Cosine Transform
Convolutional neural networks (CNNs) learn filters in order to capture local correlation patterns in feature space. We propose to learn these filters as combinations of preset spectral filters defined by the Discrete Cos…
Edge Detectionimage-classificationImage Classificationobject-detection+2Exploring Unexplored Tensor Network Decompositions for Convolutional Neural Networks
Tensor decomposition methods are widely used for model compression and fast inference in convolutional neural networks (CNNs). Although many decompositions are conceivable, only CP decomposition and a few others have bee…
Model CompressionNeural Architecture SearchTensor DecompositionTowards detecting the pathological subharmonic voicing with fully convolutional neural networks
Many voice disorders induce subharmonic phonation, but voice signal analysis is currently lacking a technique to detect the presence of subharmonics reliably. Distinguishing subharmonic phonation from normal phonation is…
Einconv: Exploring Unexplored Tensor Network Decompositions for Convolutional Neural Networks
Tensor decomposition methods are widely used for model compression and fast inference in convolutional neural networks (CNNs). Although many decompositions are conceivable, only CP decomposition and a few others have bee…
Model CompressionNeural Architecture SearchTensor Decomposition