3D Face Modeling, Analysis and Recognition

Mohamed Daoudi, TELECOM Lille 1, France Professor Daoudi is a member of the computer science department at TELECOM Lille 1, and a member of the IEEE. Prof. Daoudi is an editor of the Journal of Multimedia and has been a guest co-editor of the Annals of Telecommunications for a special issue on Technologies and Tools for 3D Imaging. He co-edited 3D Object Processing: Compression, Indexing and Watermarking published by Wiley in 2008. Anuj Srivastava, Florida State University, USA Professor Srivastava is a member of the department of statistics at Florida State University, and a member of the IEEE and ASA. He has been an associate editor of the Journal of Statistical Planning and Interference, IEEE Transactions on Signal Processing, and IEEE Transactions on Pattern Analysis and Machine Intelligence, which he also edited a special issue of on Shape Modeling. He has published over 30 journal papers and 7 book chapters in edited volumes. Remco Veltkamp, Universiteit Utrecht, The Netherlands Professor Veltkamp is a member of the department of Information and Computing Sciences at Utrecht University, focusing on multimedia applications. He is an editor of Pattern Recognition Journal and the International Journal on Shape Modeling. He has also guest edited several journals including a special issue on Multimedia Algorithmics in Multimedia Tools and Applications, and a special issue on Shape Reasoning and Understanding in Computers & Graphics. Prof. Veltkamp has published 30 journal papers, 13 book chapters in edited volumes, co-edited several conference proceedings and has co-edited State-of-the-art in Content-based Image and Video Retrieval published by Springer in 2001.

Preface List of Contributors 1 3D Face Modeling Boulbaba Ben Amor, Mohsen Ardabilian and Liming Chen 1.1 Challenges and Taxonomy of Techniques 1.2 Background 1.2.1 Depth from Triangulation 1.2.2 Shape from Shading 1.2.3 Depth from Time of Flight (ToF) 1.3 Static 3D Face Modeling 1.3.1 Laser-stripe Scanning 1.3.2 Time-coded Structured Light 1.3.3 Multiview Static Reconstruction 1.4 Dynamic 3D Face Reconstruction 1.4.1 Multiview Dynamic Reconstruction 1.4.2 Photometric Stereo 1.4.3 Structured Light 1.4.4 Spacetime Faces 1.4.5 Template-based Post-processing 1.5 Summary and Conclusions Exercises References 2 3D Face Surface Analysis and Recognition Based on Facial Surface Features Faisal Radhi M. Al-Osaimi and Mohammed Bennammoun 2.1 Geometry of 3D Facial Surface 2.1.1 Primary 3D Surface Representations 2.1.2 Rigid 3D Transformations 2.1.3 Decimation of 3D Surfaces 2.1.4 Geometric and Topological Aspects of the Human Face 2.2 Curvatures Extraction from 3D Face Surface 2.2.1 Theoretical Concepts on 3D Curvatures 2.2.2 Practical Curvature Extraction Methods 2.3 3D Face Segmentation 2.3.1 Curvature-based 3D Face Segmentation 2.3.2 Bilateral Profile-based 3D Face Segmentation 2.4 3D Face Surface Feature Extraction and Matching 2.4.1 Holistic 3D Facial Features 2.4.2 Regional 3D Facial Features 2.4.3 Point 3D Facial Features 2.5 Deformation Modeling of 3D Face Surface Exercises References 3 3D Face Surface Analysis and Recognition Based on Facial Curves Hassen Drira, Stefano Berretti, Boulbaba Ben Amor, Mohamed Daoudi, Anuj Srivastava, Alberto del Bimbo and Pietro Pala 3.1 Introduction 3.2 Facial Surface Modeling 3.3 Parametric Representation of Curves 3.4 Facial Shape Representation Using Radial Curves 3.5 Shape Space of Open Curves 3.5.1 Shape Representation 3.5.2 Geometry of Preshape Space 3.5.3 Reparametrization Estimation by Using Dynamic Programming 3.5.4 Extension to Facial Surfaces Shape Analysis 3.6 The Dense Scalar Field (DSF) 3.7 Statistical Shape Analysis 3.7.1 Statistics on Manifolds: Karcher Mean 3.7.2 Learning Statistical Models in Shape Space 3.8 Applications of Statistical Shape Analysis 3.8.1 3D Face Restoration 3.8.2 Hierarchical Organization of Facial Shapes 3.9 The Iso-geodesic Stripes 3.9.1 Extraction of Facial Stripes 3.9.2 Computing Relationships between Facial Stripes 3.9.3 Face Representation and Matching using Iso-geodesic Stripes Exercises Glossary References 4 3D Morphable Models for Face Surface Analysis and Recognition Frank B. ter Haar and Remco Veltkamp 4.1 Introduction 4.2 Data Sets 4.3 Face Model Fitting 4.3.1 Distance Measure 4.3.2 Iterative Face Fitting 4.3.3 Coarse Fitting 4.3.4 Fine Fitting 4.3.5 Multiple Components 4.3.6 Results 4.4 Dynamic Model Expansion 4.4.1 Bootstrapping Algorithm 4.4.2 Results 4.5 Face Matching 4.5.1 Comparison 4.5.2 Results 4.6 Concluding Remarks Exercises References 5 Applications Stefano Berretti, Boulbaba Ben Amor, Hassen Drira, Mohamed Daoudi, Anuj Srivastava, Alberto del Bimbo and Pietro Pala 5.1 Introduction 5.2 3D Face Databases 5.3 3D Face Recognition 5.3.1 Challenges of 3D Face Recognition 5.3.2 3D Face Recognition: State of the Art 5.3.3 Partial Face Matching 5.3.4 Comparison of State-of-the-Art Methods 5.4 Facial Expression Analysis 5.4.1 3D Facial Expression Recognition: State of the Art 5.4.2 Semi-automatic 3D Facial Expression Recognition 5.4.3 Fully Automatic 3D Facial Expression Recognition 5.5 4D Facial Expression Recognition 5.5.1 The BU-4DFE Database 5.5.2 3D Shape Motion Analysis 5.5.3 Discussion and Comparative Evaluation Exercises Glossary References Index