Supervised Deep Sparse Coding Networks
In this paper, we describe the deep sparse coding network (SCN), a novel deep network that encodes intermediate representations with nonnegative sparse coding. The SCN is built upon a number of cascading bottleneck modules, where each module consists of two sparse coding layers with relatively wide and slim dictionaries that are specialized to produce high dimensional discriminative features and low dimensional representations for clustering, respectively. During training, both the dictionaries and regularization parameters are optimized with an end-to-end supervised learning algorithm based on multilevel optimization. Effectiveness of an SCN with seven bottleneck modules is verified on several popular benchmark datasets. Remarkably, with few parameters to learn, our SCN achieves 5.81% and 19.93% classification error rate on CIFAR-10 and CIFAR-100, respectively.
Code (1)
Tasks
ClusteringGeneral ClassificationSimilar Papers 제목 키워드 기반
Sparse Coding on Stereo Video for Object Detection
Deep Convolutional Neural Networks (DCNN) require millions of labeled training examples for image classification and object detection tasks, which restrict these models to domains where such datasets are available. In th…
image-classificationImage ClassificationObjectobject-detection+1Learning Sparse Representations in Reinforcement Learning with Sparse Coding
A variety of representation learning approaches have been investigated for reinforcement learning; much less attention, however, has been given to investigating the utility of sparse coding. Outside of reinforcement lear…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Representation LearningSemi-Supervised Sparse Coding
Sparse coding approximates the data sample as a sparse linear combination of some basic codewords and uses the sparse codes as new presentations. In this paper, we investigate learning discriminative sparse codes by spar…
Supervised Convolutional Sparse Coding
Convolutional Sparse Coding (CSC) is a well-established image representation model especially suited for image restoration tasks. In this work, we extend the applicability of this model by proposing a supervised approach…
Image ReconstructionImage RestorationSparse Coding-inspired GAN for Weakly Supervised Hyperspectral Anomaly Detection
Anomaly detection (AD) on hyperspectral images (HSIs) is of great importance in both space exploration and earth observations. However, the challenges caused by insufficient datasets, no labels, and noise corruption subs…
Anomaly DetectionDecoderGenerative Adversarial NetworkWeakly-supervised Learning