Project-Out Cascaded Regression With an Application to Face Alignment
Cascaded regression approaches have been recently shown to achieve state-of-the-art performance for many computer vision tasks. Beyond its connection to boosting, cascaded regression has been interpreted as a learning-based approach to iterative optimization methods like the Newton's method. However, in prior work, the connection to optimization theory is limited only in learning a mapping from image features to problem parameters. In this paper, we consider the problem of facial deformable model fitting using cascaded regression and make the following contributions: (a) We propose regression to learn a sequence of averaged Jacobian and Hessian matrices from data, and from them descent directions in a fashion inspired by Gauss-Newton optimization. (b) We show that the optimization problem in hand has structure and devise a learning strategy for a cascaded regression approach that takes the problem structure into account. By doing so, the proposed method learns and employs a sequence of averaged Jacobians and descent directions in a subspace orthogonal to the facial appearance variation; hence, we call it Project-Out Cascaded Regression (PO-CR). (c) Based on the principles of PO-CR, we built a face alignment system that produces remarkably accurate results on the challenging iBUG data set outperforming previously proposed systems by a large margin. Code for our system is available from http://www.cs.nott.ac.uk/~yzt/.
Code (0)
등록된 구현이 없습니다.
Tasks
Face AlignmentregressionSimilar Papers 제목 키워드 기반
Self-Reinforced Cascaded Regression for Face Alignment
Cascaded regression is prevailing in face alignment thanks to its accuracy and robustness, but typically demands manually annotated examples having low discrepancy between shape-indexed features and shape updates. In thi…
Face AlignmentPhilosophyregressionEfficient Branching Cascaded Regression for Face Alignment under Significant Head Rotation
Despite much interest in face alignment in recent years, the large majority of work has focused on near-frontal faces. Algorithms typically break down on profile faces, or are too slow for real-time applications. In this…
Face AlignmentregressionEfficient and Accurate Face Alignment by Global Regression and Cascaded Local Refinement
Despite great advances witnessed on facial image alignment in recent years, high accuracy high speed face alignment algorithms still have rooms to improve especially for applications where computation resources are limit…
Face AlignmentregressionMnemonic Descent Method: A recurrent process applied for end-to-end face alignment
Cascaded regression has recently become the method of choice for solving non-linear least squares problems such as deformable image alignment. Given a sizeable training set, cascaded regression learns a set of generic ru…
Face AlignmentHead Pose EstimationPose EstimationregressionMnemonic Descent Method: A Recurrent Process Applied for End-To-End Face Alignment
Cascaded regression has recently become the method of choice for solving non-linear least squares problems such as deformable image alignment. Given a sizeable training set, cascaded regression learns a set of generic ru…
Face AlignmentHead Pose EstimationPose Estimationregression