Automatic Construction Of Robust Spherical Harmonic Subspaces
In this paper we propose a method to automatically recover a class specific low dimensional spherical harmonic basis from a set of in-the-wild facial images. We combine existing techniques for uncalibrated photometric stereo and low rank matrix decompositions in order to robustly recover a combined model of shape and identity. We build this basis without aid from a 3D model and show how it can be combined with recent efficient sparse facial feature localisation techniques to recover dense 3D facial shape. Unlike previous works in the area, our method is very efficient and is an order of magnitude faster to train, taking only a few minutes to build a model with over 2000 images. Furthermore, it can be used for real-time recovery of facial shape.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Statistical-Computational Trade-offs in Learning Multi-Index Models via Harmonic Analysis
We study the problem of learning multi-index models (MIMs), where the label depends on the input $\boldsymbol{x} \in \mathbb{R}^d$ only through an unknown $\mathsf{s}$-dimensional projection $\boldsymbol{W}_*^\mathsf{T} …
Near Optimal Reconstruction of Spherical Harmonic Expansions
We propose an algorithm for robust recovery of the spherical harmonic expansion of functions defined on the d-dimensional unit sphere $\mathbb{S}^{d-1}$ using a near-optimal number of function evaluations. We show that f…
Lightweight and Robust Multi-Channel End-to-End Speech Recognition with Spherical Harmonic Transform
This paper presents SHTNet, a lightweight spherical harmonic transform (SHT) based framework, which is designed to address cross-array generalization challenges in multi-channel automatic speech recognition (ASR) through…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)channel selectionspeech-recognition+1Global Earth Magnetic Field Modeling and Forecasting with Spherical Harmonics Decomposition
Modeling and forecasting the solar wind-driven global magnetic field perturbations is an open challenge. Current approaches depend on simulations of computationally demanding models like the Magnetohydrodynamics (MHD) mo…
Feature EngineeringFast evaluation of spherical harmonics with sphericart
Spherical harmonics provide a smooth, orthogonal, and symmetry-adapted basis to expand functions on a sphere, and they are used routinely in physical and theoretical chemistry as well as in different fields of science an…
GPU