End-to-End Kernel Learning with Supervised Convolutional Kernel Networks
In this paper, we introduce a new image representation based on a multilayer kernel machine. Unlike traditional kernel methods where data representation is decoupled from the prediction task, we learn how to shape the kernel with supervision. We proceed by first proposing improvements of the recently-introduced convolutional kernel networks (CKNs) in the context of unsupervised learning; then, we derive backpropagation rules to take advantage of labeled training data. The resulting model is a new type of convolutional neural network, where optimizing the filters at each layer is equivalent to learning a linear subspace in a reproducing kernel Hilbert space (RKHS). We show that our method achieves reasonably competitive performance for image classification on some standard "deep learning" datasets such as CIFAR-10 and SVHN, and also for image super-resolution, demonstrating the applicability of our approach to a large variety of image-related tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationImage Super-ResolutionSuper-ResolutionSimilar Papers 제목 키워드 기반
An End-to-End Graph Convolutional Kernel Support Vector Machine
A novel kernel-based support vector machine (SVM) for graph classification is proposed. The SVM feature space mapping consists of a sequence of graph convolutional layers, which generates a vector space representation fo…
ClassificationFeature EngineeringGeneral ClassificationGraph ClassificationConvolutional Kernel Networks for Graph-Structured Data
We introduce a family of multilayer graph kernels and establish new links between graph convolutional neural networks and kernel methods. Our approach generalizes convolutional kernel networks to graph-structured data, b…
Graph ClassificationThe Unreasonable Effectiveness of Patches in Deep Convolutional Kernels Methods
A recent line of work showed that various forms of convolutional kernel methods can be competitive with standard supervised deep convolutional networks on datasets like CIFAR-10, obtaining accuracies in the range of 87-9…
Object RecognitionRepresentation LearningThe Unreasonable Effectiveness of Patches in Deep Convolutional Kernels Methods.
A recent line of work showed that various forms of convolutional kernel methods can be competitive with standard supervised deep convolutional networks on datasets like CIFAR-10, obtaining accuracies in the range of 87…
Object RecognitionRepresentation LearningOrthogonal Convolutional Neural Networks
Deep convolutional neural networks are hindered by training instability and feature redundancy towards further performance improvement. A promising solution is to impose orthogonality on convolutional filters. We develop…
image-classificationImage ClassificationImage Retrieval