REAL-TIME POSE-INVARIANT FACE RECOGNITION USING THE EFFICIENT SECOND-ORDER MINIMIZATION AND THE POSE TRANSFORMING MATRIX

Abstract

We propose a real-time pose-invariant face recognition algorithm from a gallery of frontal images only. (i) We modified the second-order minimization method for the active appearance model (AAM). This allows the AAM to have the ability of correct convergence with little loss of frame rate. (ii) We proposed a pose transforming matrix that can eliminate warping artifacts of the warped face image from AAM fitting. This makes it possible to train a neural network as the face recognizer with one frontal face image of each person in the gallery set. (iii) We propose a simple method for pose recognition by using neural networks to select the proper pose transforming matrix. The proposed algorithm was evaluated on a set of 2000 facial images of 10 people (200 images for each person obtained at various poses), achieving a great improvement in recognition. (C) Koninklijke Brill NV, Leiden and The Robotics Society of Japan, 2011