A Functional Regression approach to Facial Landmark Tracking
Linear regression is a fundamental building block in many face detection and tracking algorithms, typically used to predict shape displacements from image features through a linear mapping. This paper presents a Functional Regression solution to the least squares problem, which we coin Continuous Regression, resulting in the first real-time incremental face tracker. Contrary to prior work in Functional Regression, in which B-splines or Fourier series were used, we propose to approximate the input space by its first-order Taylor expansion, yielding a closed-form solution for the continuous domain of displacements. We then extend the continuous least squares problem to correlated variables, and demonstrate the generalisation of our approach. We incorporate Continuous Regression into the cascaded regression framework, and show its computational benefits for both training and testing. We then present a fast approach for incremental learning within Cascaded Continuous Regression, coined iCCR, and show that its complexity allows real-time face tracking, being 20 times faster than the state of the art. To the best of our knowledge, this is the first incremental face tracker that is shown to operate in real-time. We show that iCCR achieves state-of-the-art performance on the 300-VW dataset, the most recent, large-scale benchmark for face tracking.
Code (0)
등록된 구현이 없습니다.
Tasks
Face DetectionIncremental LearningLandmark TrackingregressionSimilar Papers 제목 키워드 기반
Attentive One-Dimensional Heatmap Regression for Facial Landmark Detection and Tracking
Although heatmap regression is considered a state-of-the-art method to locate facial landmarks, it suffers from huge spatial complexity and is prone to quantization error. To address this, we propose a novel attentive on…
Face AlignmentFacial Landmark DetectionGPULandmark Tracking+21DFormer: a Transformer Architecture Learning 1D Landmark Representations for Facial Landmark Tracking
Recently, heatmap regression methods based on 1D landmark representations have shown prominent performance on locating facial landmarks. However, previous methods ignored to make deep explorations on the good potentials …
Landmark TrackingCascaded Continuous Regression for Real-time Incremental Face Tracking
This paper introduces a novel real-time algorithm for facial landmark tracking. Compared to detection, tracking has both additional challenges and opportunities. Arguably the most important aspect in this domain is updat…
Face AlignmentIncremental LearningLandmark TrackingregressionReal-Time Shape Tracking of Facial Landmarks
Detection of facial landmarks and accurate tracking of their shape are essential in real-time virtual makeup applications, where users can see the makeups effect by moving their face in different directions. Typical face…
Semantic SegmentationSimultaneous regression and feature learning for facial landmarking
Face alignment (or facial landmarking) is an important task in many face-related applications, ranging from registration, tracking and animation to higher-level classification problems such as face, expression or attribu…
AttributeFace Alignmentregression