Semi-supervised learning via Feedforward-Designed Convolutional Neural Networks
A semi-supervised learning framework using the feedforward-designed convolutional neural networks (FF-CNNs) is proposed for image classification in this work. One unique property of FF-CNNs is that no backpropagation is used in model parameters determination. Since unlabeled data may not always enhance semi-supervised learning, we define an effective quality score and use it to select a subset of unlabeled data in the training process. We conduct experiments on the MNIST, SVHN, and CIFAR-10 datasets, and show that the proposed semi-supervised FF-CNN solution outperforms the CNN trained by backpropagation (BP-CNN) when the amount of labeled data is reduced. Furthermore, we develop an ensemble system that combines the output decision vectors of different semi-supervised FF-CNNs to boost classification accuracy. The ensemble systems can achieve further performance gains on all three benchmarking datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingGeneral Classificationimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Semi-Supervised Vision Transformers
We study the training of Vision Transformers for semi-supervised image classification. Transformers have recently demonstrated impressive performance on a multitude of supervised learning tasks. Surprisingly, we show Vis…
image-classificationImage ClassificationInductive BiasSemi-Supervised Image ClassificationSupervised and Semi-supervised Deep Probabilistic Models for Indoor Positioning Problems
Predicting smartphone users location with WiFi fingerprints has been a popular research topic recently. In this work, we propose two novel deep learning-based models, the convolutional mixture density recurrent neural ne…
Unsupervised Feedforward Feature (UFF) Learning for Point Cloud Classification and Segmentation
In contrast to supervised backpropagation-based feature learning in deep neural networks (DNNs), an unsupervised feedforward feature (UFF) learning scheme for joint classification and segmentation of 3D point clouds is p…
ClassificationDecoderGeneral ClassificationPoint Cloud Classification+1Flattened Convolutional Neural Networks for Feedforward Acceleration
We present flattened convolutional neural networks that are designed for fast feedforward execution. The redundancy of the parameters, especially weights of the convolutional filters in convolutional neural networks has …
Ensembles of feedforward-designed convolutional neural networks
An ensemble method that fuses the output decision vectors of multiple feedforward-designed convolutional neural networks (FF-CNNs) to solve the image classification problem is proposed in this work. To enhance the perfor…
DiversityGeneral Classificationimage-classificationImage Classification