Toward Understanding Convolutional Neural Networks from Volterra Convolution Perspective
We make an attempt to understanding convolutional neural network by exploring the relationship between (deep) convolutional neural networks and Volterra convolutions. We propose a novel approach to explain and study the overall characteristics of neural networks without being disturbed by the horribly complex architectures. Specifically, we attempt to convert the basic structures of a convolutional neural network (CNN) and their combinations to the form of Volterra convolutions. The results show that most of convolutional neural networks can be approximated in the form of Volterra convolution, where the approximated proxy kernels preserve the characteristics of the original network. Analyzing these proxy kernels may give valuable insight about the original network. Base on this setup, we presented methods to approximating the order-zero and order-one proxy kernels, and verified the correctness and effectiveness of our results.
Code (1)
Tasks
FormSimilar Papers 제목 키워드 기반
VolterraNet: A higher order convolutional network with group equivariance for homogeneous manifolds
Convolutional neural networks have been highly successful in image-based learning tasks due to their translation equivariance property. Recent work has generalized the traditional convolutional layer of a convolutional n…
Diffusion MRITranslationEfficient Higher-order Convolution for Small Kernels in Deep Learning
Deep convolutional neural networks (DCNNs) are a class of artificial neural networks, primarily for computer vision tasks such as segmentation and classification. Many nonlinear operations, such as activation functions a…
Deep LearningLatent Code-Based Fusion: A Volterra Neural Network Approach
We propose a deep structure encoder using the recently introduced Volterra Neural Networks (VNNs) to seek a latent representation of multi-modal data whose features are jointly captured by a union of subspaces. The so-ca…
ClusteringRobust classificationA General Architecture for Behavior Modeling of Nonlinear Power Amplifier using Deep Convolutional Neural Network
Nonlinearity of power amplifier is one of the major limitations to the achievable capacity in wireless transmission systems. Nonlinear impairments are determined by the nonlinear distortions of the power amplifier and mo…
Volterra Neural Networks (VNNs)
The importance of inference in Machine Learning (ML) has led to an explosive number of different proposals in ML, and particularly in Deep Learning. In an attempt to reduce the complexity of Convolutional Neural Networks…
Action RecognitionOptical Flow Estimation