Merging SVMs with Linear Discriminant Analysis: A Combined Model
A key problem often encountered by many learning algorithms in computer vision dealing with high dimensional data is the so called "curse of dimensionality" which arises when the available training samples are less than the input feature space dimensionality. To remedy this problem, we propose a joint dimensionality reduction and classification framework by formulating an optimization problem within the maximum margin class separation task. The proposed optimization problem is solved using alternative optimization where we jointly compute the low dimensional maximum margin projections and the separating hyperplanes in the projection subspace. Moreover, in order to reduce the computational cost of the developed optimization algorithm we incorporate orthogonality constraints on the derived projection bases and show that the resulting combined model is an alternation between identifying the optimal separating hyperplanes and performing a linear discriminant analysis on the support vectors. Experiments on face, facial expression and object recognition validate the effectiveness of the proposed method against state-of-the-art dimensionality reduction algorithms.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionObject RecognitionSimilar Papers 제목 키워드 기반
Polyhedral Conic Classifiers for Visual Object Detection and Classification
We propose a family of quasi-linear discriminants that outperform current large-margin methods in sliding window visual object detection and open set recognition tasks. In these tasks the classification problems are b…
ClassificationGeneral ClassificationObjectobject-detection+2Examining Uniqueness and Permanence of the WAY EEG GAL dataset toward User Authentication
This study evaluates the discriminating capacity (uniqueness) of the EEG data from the WAY EEG GAL public dataset to authenticate individuals against one another as well as its permanence. In addition to the EEG data, Lu…
EEGElectroencephalogram (EEG)Feature ImportanceTransfer Learning for Action Unit Recognition
This paper presents a classifier ensemble for Facial Expression Recognition (FER) based on models derived from transfer learning. The main experimentation work is conducted for facial action unit detection using feature …
Action Unit DetectionFacial Action Unit DetectionFacial Expression RecognitionFacial Expression Recognition (FER)+1Transfer learning via Regularized Linear Discriminant Analysis
Linear discriminant analysis is a widely used method for classification. However, the high dimensionality of predictors combined with small sample sizes often results in large classification errors. To address this chall…
ClassificationTransfer LearningDomain-decomposed image classification algorithms using linear discriminant analysis and convolutional neural networks
In many modern computer application problems, the classification of image data plays an important role. Among many different supervised machine learning models, convolutional neural networks (CNNs) and linear discriminan…
Classificationimage-classificationImage ClassificationTransfer Learning