Morphable Face Models - An Open Framework

Gerig, Thomas and Morel-Forster, Andreas and Blumer, Clemens and Egger, Bernhard and Lüthi, Marcel and Schönborn, Sandro and Vetter, Thomas. (2018) Morphable Face Models - An Open Framework. In: 13th IEEE Conference on Automatic Face and Gesture Recognition (FG 2018). pp. 75-82.

[img] PDF
Restricted to Repository staff only


Official URL: https://edoc.unibas.ch/69084/

Downloads: Statistics Overview


In this paper, we present a novel open-source pipeline for face registration based on Gaussian processes as well as an application to face image analysis. Non-rigid regis- tration of faces is significant for many applications in computer vision, such as the construction of 3D Morphable face models (3DMMs). Gaussian Process Morphable Models (GPMMs) unify a variety of non-rigid deformation models with B-splines and PCA models as examples. GPMM separate problem specific requirements from the registration algorithm by incorporating domain-specific adaptions as a prior model. The novelties of this paper are the following: (i) We present a strategy and modeling technique for face registration that considers symmetry, multi- scale and spatially-varying details. The registration is applied to neutral faces and facial expressions. (ii) We release an open- source software framework for registration and model-building demonstrated on the publicly available BU3D-FE database. The released pipeline also contains an implementation of an Analysis- by-Synthesis model adaption of 2D face images, tested on the Multi-PIE and LFW database. This enables the community to reproduce, evaluate and compare the individual steps of registration to model-building and 3D/2D model fitting. (iii) Along with the framework release, we publish a new version of the Basel Face Model (BFM-2017) with an improved age distribution and an additional facial expression model.
Faculties and Departments:05 Faculty of Science > Departement Mathematik und Informatik > Ehemalige Einheiten Mathematik & Informatik > Computergraphik Bilderkennung (Vetter)
UniBasel Contributors:Vetter, Thomas and Gerig, Thomas and Morel, Andreas and Lüthi, Marcel
Item Type:Conference or Workshop Item, refereed
Conference or workshop item Subtype:Conference Paper
Note:Publication type according to Uni Basel Research Database: Conference paper
Related URLs:
Identification Number:
edoc DOI:
Last Modified:20 Mar 2019 15:30
Deposited On:27 Feb 2019 13:48

Repository Staff Only: item control page