Deep Radial Kernel Networks: Approximating Radially Symmetric Functions with Deep Networks
We prove that a particular deep network architecture is more efficient at approximating radially symmetric functions than the best known 2 or 3 layer networks. We use this architecture to approximate Gaussian kernel SVMs, and subsequently improve upon them with further training. The architecture and initial weights of the Deep Radial Kernel Network are completely specified by the SVM and therefore sidesteps the problem of empirically choosing an appropriate deep network architecture.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Non-Parametric Structure-Based Calibration of Radially Symmetric Cameras
We propose a novel two-step method for estimating the intrinsic and extrinsic calibration of any radially symmetric camera, including non-central systems. The first step consists of estimating the camera pose, given a St…
TranslationOptimal bump functions for shallow ReLU networks: Weight decay, depth separation and the curse of dimensionality
In this note, we study how neural networks with a single hidden layer and ReLU activation interpolate data drawn from a radially symmetric distribution with target labels 1 at the origin and 0 outside the unit ball, if n…
Rotation Equivariant Operators for Machine Learning on Scalar and Vector Fields
We develop theory and software for rotation equivariant operators on scalar and vector fields, with diverse applications in simulation, optimization and machine learning. Rotation equivariance (covariance) means all fiel…
BIG-bench Machine LearningTranslationLearning View-Dependent Splatting Kernels
We present a differentiable framework to automatically learn view-dependent 2D kernels in a splatting-based pipeline to improve reconstruction quality and representation efficiency for novel 3D view synthesis. Our volume…
Convolution kernel adaptation to calibrated fisheye
Convolution kernels are the basic structural component of convolutional neural networks (CNNs). In the last years there has been a growing interest in fisheye cameras for many applications. However, the radially symmetri…
Depth EstimationSemantic Segmentation