PixelHop: A Successive Subspace Learning (SSL) Method for Object Classification
A new machine learning methodology, called successive subspace learning (SSL), is introduced in this work. SSL contains four key ingredients: 1) successive near-to-far neighborhood expansion; 2) unsupervised dimension reduction via subspace approximation; 3) supervised dimension reduction via label-assisted regression (LAG); and 4) feature concatenation and decision making. An image-based object classification method, called PixelHop, is proposed to illustrate the SSL design. It is shown by experimental results that the PixelHop method outperforms the classic CNN model of similar model complexity in three benchmarking datasets (MNIST, Fashion MNIST and CIFAR-10). Although SSL and deep learning (DL) have some high-level concept in common, they are fundamentally different in model formulation, the training process and training complexity. Extensive discussion on the comparison of SSL and DL is made to provide further insights into the potential of SSL.
Code (2)
Tasks
BenchmarkingDecision MakingDimensionality ReductionGeneral ClassificationSimilar Papers 제목 키워드 기반
PixelHop++: A Small Successive-Subspace-Learning-Based (SSL-based) Model for Image Classification
The successive subspace learning (SSL) principle was developed and used to design an interpretable learning model, known as the PixelHop method,for image classification in our prior work. Here, we propose an improved Pix…
ClassificationGeneral Classificationimage-classificationImage ClassificationE-PixelHop: An Enhanced PixelHop Method for Object Classification
Based on PixelHop and PixelHop++, which are recently developed using the successive subspace learning (SSL) framework, we propose an enhanced solution for object classification, called E-PixelHop, in this work. E-PixelHo…
Binary ClassificationClassificationMulti-class ClassificationObjectStatistical Attention Localization (SAL): Methodology and Application to Object Classification
A statistical attention localization (SAL) method is proposed to facilitate the object classification task in this work. SAL consists of three steps: 1) preliminary attention window selection via decision statistics, 2) …
ClassificationObjectGENHOP: An Image Generation Method Based on Successive Subspace Learning
Being different from deep-learning-based (DL-based) image generation methods, a new image generative model built upon successive subspace learning principle is proposed and named GenHop (an acronym of Generative PixelHop…
Dimensionality ReductionImage GenerationFaceHop: A Light-Weight Low-Resolution Face Gender Classification Method
A light-weight low-resolution face gender classification method, called FaceHop, is proposed in this research. We have witnessed rapid progress in face gender classification accuracy due to the adoption of deep learning …
ClassificationGender ClassificationGeneral Classification