2D Image head pose estimation via latent space regression under occlusion settings
Head orientation is a challenging Computer Vision problem that has been extensively researched having a wide variety of applications. However, current state-of-the-art systems still underperform in the presence of occlusions and are unreliable for many task applications in such scenarios. This work proposes a novel deep learning approach for the problem of head pose estimation under occlusions. The strategy is based on latent space regression as a fundamental key to better structure the problem for occluded scenarios. Our model surpasses several state-of-the-art methodologies for occluded HPE, and achieves similar accuracy for non-occluded scenarios. We demonstrate the usefulness of the proposed approach with: (i) two synthetically occluded versions of the BIWI and AFLW2000 datasets, (ii) real-life occlusions of the Pandora dataset, and (iii) a real-life application to human-robot interaction scenarios where face occlusions often occur. Specifically, the autonomous feeding from a robotic arm.
Code (1)
Tasks
Head Pose EstimationPose EstimationregressionSimilar Papers 제목 키워드 기반
PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation
State-of-the-art single-image 3D reconstruction methods often rely on complex hybrid architectures and loss functions, or compress geometry into latent spaces in order to leverage pre-trained latent diffusion models. In …
3D ReconstructionRobust Head-Pose Estimation Based on Partially-Latent Mixture of Linear Regressions
Head-pose estimation has many applications, such as social event analysis, human-robot and human-computer interaction, driving assistance, and so forth. Head-pose estimation is challenging because it must cope with chang…
Face AlignmentHead Pose EstimationPose EstimationLatent Embedding Clustering for Occlusion Robust Head Pose Estimation
Head pose estimation has become a crucial area of research in computer vision given its usefulness in a wide range of applications, including robotics, surveillance, or driver attention monitoring. One of the most diffic…
ClusteringDriver Attention MonitoringHead Pose EstimationPose EstimationReDirTrans: Latent-to-Latent Translation for Gaze and Head Redirection
Learning-based gaze estimation methods require large amounts of training data with accurate gaze annotations. Facing such demanding requirements of gaze data collection and annotation, several image synthesis methods wer…
AttributeGaze EstimationImage GenerationTranslationTalking Head from Speech Audio using a Pre-trained Image Generator
We propose a novel method for generating high-resolution videos of talking-heads from speech audio and a single 'identity' image. Our method is based on a convolutional neural network model that incorporates a pre-traine…
SSIM