paper-with-me

홈 › Papers

2D Image head pose estimation via latent space regression under occlusion settings

2023-11-10 · José Celestino, Manuel Marques, Jacinto C. Nascimento, João Paulo Costeira

Head orientation is a challenging Computer Vision problem that has been extensively researched having a wide variety of applications. However, current state-of-the-art systems still underperform in the presence of occlusions and are unreliable for many task applications in such scenarios. This work proposes a novel deep learning approach for the problem of head pose estimation under occlusions. The strategy is based on latent space regression as a fundamental key to better structure the problem for occluded scenarios. Our model surpasses several state-of-the-art methodologies for occluded HPE, and achieves similar accuracy for non-occluded scenarios. We demonstrate the usefulness of the proposed approach with: (i) two synthetically occluded versions of the BIWI and AFLW2000 datasets, (ii) real-life occlusions of the Pandora dataset, and (iii) a real-life application to human-robot interaction scenarios where face occlusions often occur. Specifically, the autonomous feeding from a robotic arm.

📄 PDF Abstract BibTeX arXiv:2311.06038

Code (1)

sipg-isr/Occlusion_HPE 공식 구현 pytorch

Tasks

Head Pose EstimationPose Estimationregression

Similar Papers 제목 키워드 기반

PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation

2026-07-02 · Haofei Xu, Rundi Wu, Philipp Henzler, Nikolai Kalischek 외 arxiv

State-of-the-art single-image 3D reconstruction methods often rely on complex hybrid architectures and loss functions, or compress geometry into latent spaces in order to leverage pre-trained latent diffusion models. In …

3D Reconstruction

Robust Head-Pose Estimation Based on Partially-Latent Mixture of Linear Regressions

2016-03-31 · Vincent Drouard, Radu Horaud, Antoine Deleforge, Silèye Ba 외

Head-pose estimation has many applications, such as social event analysis, human-robot and human-computer interaction, driving assistance, and so forth. Head-pose estimation is challenging because it must cope with chang…

Face AlignmentHead Pose EstimationPose Estimation

Latent Embedding Clustering for Occlusion Robust Head Pose Estimation

2024-03-29 · José Celestino, Manuel Marques, Jacinto C. Nascimento

Head pose estimation has become a crucial area of research in computer vision given its usefulness in a wide range of applications, including robotics, surveillance, or driver attention monitoring. One of the most diffic…

ClusteringDriver Attention MonitoringHead Pose EstimationPose Estimation

ReDirTrans: Latent-to-Latent Translation for Gaze and Head Redirection

2023-05-19 · CVPR 2023 1 · Shiwei Jin, Zhen Wang, Lei Wang, Ning Bi 외

Learning-based gaze estimation methods require large amounts of training data with accurate gaze annotations. Facing such demanding requirements of gaze data collection and annotation, several image synthesis methods wer…

AttributeGaze EstimationImage GenerationTranslation

Talking Head from Speech Audio using a Pre-trained Image Generator

2022-09-09 · Mohammed M. Alghamdi, He Wang, Andrew J. Bulpitt, David C. Hogg

We propose a novel method for generating high-resolution videos of talking-heads from speech audio and a single 'identity' image. Our method is based on a convolutional neural network model that incorporates a pre-traine…

SSIM