paper-with-me

Papers

Gaussian Process Morphable Models

2016-03-23 · Marcel Lüthi, Christoph Jud, Thomas Gerig, Thomas Vetter

Statistical shape models (SSMs) represent a class of shapes as a normal distribution of point variations, whose parameters are estimated from example shapes. Principal component analysis (PCA) is applied to obtain a low-dimensional representation of the shape variation in terms of the leading principal components. In this paper, we propose a generalization of SSMs, called Gaussian Process Morphable Models (GPMMs). We model the shape variations with a Gaussian process, which we represent using the leading components of its Karhunen-Loeve expansion. To compute the expansion, we make use of an approximation scheme based on the Nystrom method. The resulting model can be seen as a continuous analogon of an SSM. However, while for SSMs the shape variation is restricted to the span of the example data, with GPMMs we can define the shape variation using any Gaussian process. For example, we can build shape models that correspond to classical spline models, and thus do not require any example data. Furthermore, Gaussian processes make it possible to combine different models. For example, an SSM can be extended with a spline model, to obtain a model that incorporates learned shape characteristics, but is flexible enough to explain shapes that cannot be represented by the SSM. We introduce a simple algorithm for fitting a GPMM to a surface or image. This results in a non-rigid registration approach, whose regularization properties are defined by a GPMM. We show how we can obtain different registration schemes,including methods for multi-scale, spatially-varying or hybrid registration, by constructing an appropriate GPMM. As our approach strictly separates modelling from the fitting process, this is all achieved without changes to the fitting algorithm. We show the applicability and versatility of GPMMs on a clinical use case, where the goal is the model-based segmentation of 3D forearm images.

📄 PDF Abstract BibTeX arXiv:1603.07254

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian Processes

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

SplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surface

2024-03-27 · Jiahao Luo, Jing Liu, James Davis

We present SplatFace, a novel Gaussian splatting framework designed for 3D human face reconstruction without reliance on accurate pre-determined geometry. Our method is designed to simultaneously deliver both high-qualit…

3D ReconstructionFace ReconstructionNovel View Synthesis

GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians

2023-12-04 · CVPR 2024 1 · Shenhan Qian, Tobias Kirschstein, Liam Schoneveld, Davide Davoli 외

We introduce GaussianAvatars, a new method to create photorealistic head avatars that are fully controllable in terms of expression, pose, and viewpoint. The core idea is a dynamic 3D representation based on 3D Gaussian …

Face Model

Building 3D Morphable Models from a Single Scan

2020-11-24 · Skylar Sutherland, Bernhard Egger, Joshua Tenenbaum

We propose a method for constructing generative models of 3D objects from a single 3D mesh. Our method produces a 3D morphable model that represents shape and albedo in terms of Gaussian processes. We define the shape de…

Face RecognitionGaussian ProcessesInverse Rendering

Morphable Face Models - An Open Framework

2017-09-25 · Thomas Gerig, Andreas Morel-Forster, Clemens Blumer, Bernhard Egger 외

In this paper, we present a novel open-source pipeline for face registration based on Gaussian processes as well as an application to face image analysis. Non-rigid registration of faces is significant for many applicati…

Face ModelGaussian Processes

PSAvatar: A Point-based Shape Model for Real-Time Head Avatar Animation with 3D Gaussian Splatting

2024-01-23 · Zhongyuan Zhao, Zhenyu Bao, Qing Li, Guoping Qiu 외

Despite much progress, achieving real-time high-fidelity head avatar animation is still difficult and existing methods have to trade-off between speed and quality. 3DMM based methods often fail to model non-facial struct…