Frankenstein: Learning Deep Face Representations using Small Data
Deep convolutional neural networks have recently proven extremely effective for difficult face recognition problems in uncontrolled settings. To train such networks, very large training sets are needed with millions of labeled images. For some applications, such as near-infrared (NIR) face recognition, such large training datasets are not publicly available and difficult to collect. In this work, we propose a method to generate very large training datasets of synthetic images by compositing real face images in a given dataset. We show that this method enables to learn models from as few as 10,000 training images, which perform on par with models trained from 500,000 images. Using our approach we also obtain state-of-the-art results on the CASIA NIR-VIS2.0 heterogeneous face recognition dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Face RecognitionHeterogeneous Face RecognitionSmall Data Image ClassificationSimilar Papers 제목 키워드 기반
Frankenstein in the Pipeline: Computational Epistemicide in Facial Recognition
While the eugenic roots of computer vision are well-documented in critical technology studies, less attention has been paid to the operational mechanisms through which this violence is enacted at the level of the pipelin…
Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies
We present a unified deformation model for the markerless capture of multiple scales of human movement, including facial expressions, body motion, and hand gestures. An initial model is generated by locally stitching tog…
Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Plane
We present Frankenstein, a diffusion-based framework that can generate semantic-compositional 3D scenes in a single pass. Unlike existing methods that output a single, unified 3D shape, Frankenstein simultaneously genera…
DenoisingObject RearrangementFrankenstein Optimizer: Harnessing the Potential by Revisiting Optimization Tricks
Gradient-based optimization drives the unprecedented performance of modern deep neural network models across diverse applications. Adaptive algorithms have accelerated neural network training due to their rapid convergen…
Few-Shot LearningAutomatic Frankensteining: Creating Complex Ensembles Autonomously
Automating machine learning by providing techniques that autonomously find the best algorithm, hyperparameter configuration and preprocessing is helpful for both researchers and practitioners. Therefore, it is not surpri…
AutoMLBIG-bench Machine LearningCPU