Markov Chain Monte Carlo for Automated Face Image Analysis

Schönborn, Sandro and Egger, Bernhard and Morel-Forster, Andreas and Vetter, Thomas. (2017) Markov Chain Monte Carlo for Automated Face Image Analysis. International Journal of Computer Vision, 123 (2). pp. 160-183.

[img] PDF - Accepted Version

Official URL: https://edoc.unibas.ch/59207/

Downloads: Statistics Overview


We present a novel fully probabilistic method to interpret a single face image with the 3D Morphable Model. The new method is based on Bayesian inference and makes use of unreliable image-based information. Rather than searching a single optimal solution, we infer the posterior distribution of the model parameters given the target image. The method is a stochastic sampling algorithm with a propose-and-verify architecture based on the Metropolis–Hastings algorithm. The stochastic method can robustly integrate unreliable information and therefore does not rely on feed-forward initialization. The integrative concept is based on two ideas, a separation of proposal moves and their verification with the model (Data-Driven Markov Chain Monte Carlo), and filtering with the Metropolis acceptance rule. It does not need gradients and is less prone to local optima than standard fitters. We also introduce a new collective likelihood which models the average difference between the model and the target image rather than individual pixel differences. The average value shows a natural tendency towards a normal distribution, even when the individual pixel-wise difference is not Gaussian. We employ the new fitting method to calculate posterior models of 3D face reconstructions from single real-world images. A direct application of the algorithm with the 3D Morphable Model leads us to a fully automatic face recognition system with competitive performance on the Multi-PIE database without any database adaptation.
Faculties and Departments:05 Faculty of Science > Departement Mathematik und Informatik > Ehemalige Einheiten Mathematik & Informatik > Computergraphik Bilderkennung (Vetter)
UniBasel Contributors:Vetter, Thomas
Item Type:Article, refereed
Article Subtype:Research Article
Note:Publication type according to Uni Basel Research Database: Journal article -- The final publication is available at Springer see DOI link.
Identification Number:
edoc DOI:
Last Modified:09 Feb 2018 12:21
Deposited On:09 Feb 2018 12:11

Repository Staff Only: item control page