 |
    |
Using 3D Models for Real-Time Facial Feature Tracking, Pose Estimation, and Expression Monitoring
Angela Caunce and Tim Cootes
Imaging Science and Biomedical Engineering, The University of Manchester, UKAbstract. We present an application which uses 3D statistical shape models to track a subject in real time using a single fixed camera. The system can handle large pose variation; variable illumination; occlusion; glasses. Since the models are 3D, the application can report pose information which may be vital in a safety context such as driving attentiveness. Two models are used in tandem, one for identity and one for facial actions, enabling the system to also estimate the user’s behavioural state at a basic level. The system works directly on the captured images, with no pre-processing, and tracks the facial features using simple template matching and boundary detection. The parameters of the identity model adapt over time to the model subspace occupied by the subject, and this allows the second model to describe simple actions such as eye, brow, and mouth movement. The parameters of the actions model are then used to identify smiling, frowning, talking, and blinking using simple linear discriminants.
LNCS 7585, p. 651 ff.
lncs@springer.com
© Springer-Verlag Berlin Heidelberg 2012