paper-with-me

홈 › Papers

Deep Learning-based Single Image Face Depth Data Enhancement

2020-06-19 · Torsten Schlett, Christian Rathgeb, Christoph Busch

Face recognition can benefit from the utilization of depth data captured using low-cost cameras, in particular for presentation attack detection purposes. Depth video output from these capture devices can however contain defects such as holes or general depth inaccuracies. This work proposes a deep learning face depth enhancement method in this context of facial biometrics, which adds a security aspect to the topic. U-Net-like architectures are utilized, and the networks are compared against hand-crafted enhancer types, as well as a similar depth enhancer network from related work trained for an adjacent application scenario. All tested enhancer types exclusively use depth data as input, which differs from methods that enhance depth based on additional input data such as visible light color images. Synthetic face depth ground truth images and degraded forms thereof are created with help of PRNet, to train multiple deep learning enhancer models with different network sizes and training configurations. Evaluations are carried out on the synthetic data, on Kinect v1 images from the KinectFaceDB, and on in-house RealSense D435 images. These evaluations include an assessment of the falsification for occluded face depth input, which is relevant to biometric security. The proposed deep learning enhancers yield noticeably better results than the tested preexisting enhancers, without overly falsifying depth data when non-face input is provided, and are shown to reduce the error of a simple landmark-based PAD method.

📄 PDF Abstract BibTeX arXiv:2006.11091

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningFace Recognition

Similar Papers 제목 키워드 기반

Depth Image Enhancement Using Local Tangent Plane Approximations

2015-06-01 · CVPR 2015 6 · Kiyoshi Matsuo, Yoshimitsu Aoki

This paper describes a depth image enhancement method for consumer RGB-D cameras. Most existing methods use the pixel-coordinates of the aligned color image. Because the image plane generally has no relationship to the m…

Image EnhancementSurface Reconstruction

Face Image Lighting Enhancement Using a 3D Model

2022-07-02 · Qiulin Chen, Jan P. Allebach

Image enhancement helps to generate balanced lighting distributions over faces. Our goal is to get an illuminance-balanced enhanced face image from a single view. Traditionally, image enhancement methods ignore the 3D ge…

3D geometryFace AlignmentImage Enhancementmodel

Reconstruction-based Pairwise Depth Dataset for Depth Image Enhancement Using CNN

2018-09-01 · ECCV 2018 9 · Junho Jeon, Seungyong Lee

Raw depth images captured by consumer depth cameras suffer from noisy and missing values. Despite the success of CNN-based image processing on color image restoration, similar approaches for depth enhancement have not be…

3D ReconstructionDataset GenerationImage EnhancementImage Restoration+2

Accurate Ground-Truth Depth Image Generation via Overfit Training of Point Cloud Registration using Local Frame Sets

2022-07-14 · Jiwan Kim, Minchang Kim, Yeong-Gil Shin, Minyoung Chung

Accurate three-dimensional perception is a fundamental task in several computer vision applications. Recently, commercial RGB-depth (RGB-D) cameras have been widely adopted as single-view depth-sensing devices owing to t…

Image GenerationPoint Cloud Registration

Semantic-Guided Representation Enhancement for Self-supervised Monocular Trained Depth Estimation

2020-12-15 · Rui Li, Qing Mao, Pei Wang, Xiantuo He 외

Self-supervised depth estimation has shown its great effectiveness in producing high quality depth maps given only image sequences as input. However, its performance usually drops when estimating on border areas or objec…

Depth EstimationSemantic Segmentation