paper-with-me

홈 › Papers

Understanding Unconventional Preprocessors in Deep Convolutional Neural Networks for Face Identification

2019-03-27 · Chollette C. Olisah, Lyndon Smith

Deep networks have achieved huge successes in application domains like object and face recognition. The performance gain is attributed to different facets of the network architecture such as: depth of the convolutional layers, activation function, pooling, batch normalization, forward and back propagation and many more. However, very little emphasis is made on the preprocessors. Therefore, in this paper, the network's preprocessing module is varied across different preprocessing approaches while keeping constant other facets of the network architecture, to investigate the contribution preprocessing makes to the network. Commonly used preprocessors are the data augmentation and normalization and are termed conventional preprocessors. Others are termed the unconventional preprocessors, they are: color space converters; HSV, CIE L*a*b* and YCBCR, grey-level resolution preprocessors; full-based and plane-based image quantization, illumination normalization and insensitive feature preprocessing using: histogram equalization (HE), local contrast normalization (LN) and complete face structural pattern (CFSP). To achieve fixed network parameters, CNNs with transfer learning is employed. Knowledge from the high-level feature vectors of the Inception-V3 network is transferred to offline preprocessed LFW target data; and features trained using the SoftMax classifier for face identification. The experiments show that the discriminative capability of the deep networks can be improved by preprocessing RGB data with HE, full-based and plane-based quantization, rgbGELog, and YCBCR, preprocessors before feeding it to CNNs. However, for best performance, the right setup of preprocessed data with augmentation and/or normalization is required. The plane-based image quantization is found to increase the homogeneity of neighborhood pixels and utilizes reduced bit depth for better storage efficiency.

📄 PDF Abstract BibTeX arXiv:1904.00815

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationFace IdentificationFace RecognitionQuantizationTransfer Learning

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음
Auxiliary Classifier Auxiliary Classifiers are type of architectural component that seek to improve the convergence of very deep networks. They are classifier heads we attach to layers before the…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
RMSProp RMSProp is an unpublished adaptive learning rate optimizer proposed by Geoff Hinton. The motivation…
Inception-v3 Module Inception-v3 Module is an image block used in the Inception-v3 architecture. This architecture is used on the coarsest (8 ×…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Preprocessor Selection for Machine Learning Pipelines

2018-10-23 · Brandon Schoenfeld, Christophe Giraud-Carrier, Mason Poggemann, Jarom Christensen 외

Much of the work in metalearning has focused on classifier selection, combined more recently with hyperparameter optimization, with little concern for data preprocessing. Yet, it is generally well accepted that machine l…

BIG-bench Machine LearningHyperparameter Optimization

Identification at the Zero Lower Bound

2021-03-23 · Sophocles Mavroeidis

I show that the Zero Lower Bound (ZLB) on interest rates can be used to identify the causal effects of monetary policy. Identification depends on the extent to which the ZLB limits the efficacy of monetary policy. I prop…

Hierarchical Character-Word Models for Language Identification

2016-08-10 · WS 2016 11 · Aaron Jaech, George Mulcaire, Shobhit Hathi, Mari Ostendorf 외

Social media messages' brevity and unconventional spelling pose a challenge to language identification. We introduce a hierarchical model that learns character and contextualized word-level representations for language i…

Language Identification

Preprocessors Matter! Realistic Decision-Based Attacks on Machine Learning Systems

2022-10-07 · Chawin Sitawarin, Florian Tramèr, Nicholas Carlini

Decision-based attacks construct adversarial examples against a machine learning (ML) model by making only hard-label queries. These attacks have mainly been applied directly to standalone neural networks. However, in pr…

Vector OFDM Transmission over Non-Gaussian Power Line Communication Channels

2018-06-26

Most of the recent power line communication (PLC) systems and standards, both narrow-band and broadband, are based on orthogonal frequency-division multiplexing (OFDM). This multiplexing scheme however suffers from the h…