Probabilistic Joint Face-Skull Modelling for Facial Reconstruction

Madsen, Dennis and Lüthi, Marcel and Schneider, Andreas and Vetter, Thomas. (2018) Probabilistic Joint Face-Skull Modelling for Facial Reconstruction. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 5295-5303.

PDF - Accepted Version

Official URL: https://edoc.unibas.ch/69082/

Downloads: Statistics Overview


We present a novel method for co-registration of two independent statistical shape models. We solve the problem of aligning a face model to a skull model with stochastic optimization based on Markov Chain Monte Carlo (MCMC). We create a probabilistic joint face-skull model and show how to obtain a distribution of plausible face shapes given a skull shape. Due to environmental and genetic factors, there exists a distribution of possible face shapes arising from the same skull. We pose facial reconstruction as a conditional distribution of plausible face shapes given a skull shape. Because it is very difficult to obtain the distribution directly from MRI or CT data, we create a dataset of artificial face-skull pairs. To do this, we propose to combine three data sources of independent origin to model the joint face-skull distribution: a face shape model, a skull shape model and tissue depth marker information. For a given skull, we compute the posterior distribution of faces matching the tissue depth distribution with Metropolis-Hastings. We estimate the joint faceskull distribution from samples of the posterior. To find faces matching to an unknown skull, we estimate the probability of the face under the joint faceskull model. To our knowledge, we are the first to provide a whole distribution of plausible faces arising from a skull instead of only a single reconstruction. We show how the face-skull model can be used to rank a face dataset and on average successfully identify the correct match in top 30%. The face ranking even works when obtaining the face shapes from 2D images. We furthermore show how the face-skull model can be useful to estimate the skull position in an MR-image.
Faculties and Departments:05 Faculty of Science > Departement Mathematik und Informatik > Ehemalige Einheiten Mathematik & Informatik > Computergraphik Bilderkennung (Vetter)
UniBasel Contributors:Vetter, Thomas and Madsen, Dennis and Lüthi, Marcel
Item Type:Conference or Workshop Item, refereed
Conference or workshop item Subtype:Conference Paper
Publisher:Computer Vision Foundation
Note:Publication type according to Uni Basel Research Database: Conference paper
Related URLs:
Identification Number:
edoc DOI:
Last Modified:08 Mar 2019 13:46
Deposited On:27 Feb 2019 13:06

Repository Staff Only: item control page