Low-level Fusion and Deformation Modeling for Textured 3D Face Biometrics

Low-level Fusion and Deformation Modeling for Textured 3D Face Biometrics
Author: Faisal Radhi M. Al-Osaimi
Publisher:
Total Pages: 152
Release: 2009
Genre: Biometry
ISBN:

Download Low-level Fusion and Deformation Modeling for Textured 3D Face Biometrics Book in PDF, Epub and Kindle

[Truncated abstract] Automatic face recognition has many crucial applications in a range of domains including human-machine interaction and security. The non-intrusive nature of face recognition is a key reason behind its suitability to such a broad range of applications. However, often these applications require high recognition accuracies and robustness which are challenging to achieve due to variations. Variations in pose, facial expression and illumination conditions may obscure the essential visual and/or geometric cues for recognition. The ability of a face recognition system to represent and match faces such that the utilized descriptive cues outweigh the associated variations is a key factor in enhancing its accuracy and robustness. This thesis presents novel algorithms that strive to achieve this goal by combining the descriptive cues in textured 3D facial scans at lower levels (data and feature fusion levels) and/or modeling the facial expression and illumination variations. An approach for combining fields of weak local and global geometrical cues (computed for each scan vertex) at the feature level was devised and used for compact representation and matching of 3D faces. The extracted fields are independent of the coordinate system in which the scan vertices were defined and hence the representation is tolerant to minor pose variations. The combined representation has demonstrated considerably high descriptiveness. In another presented approach, only local regions around key-points on the facial scans were considered. Heuristic measures for the descriptiveness of 3D local regions were defined and used for robust matching. The matching enforces consistent 3D rigid transformations and global structures among matched scans but on the other hand it allows for few mismatches among the local regions. Hence, it avoids the effects of deformed regions on matching. While the above strategies of combining information with and without the avoidance of the deformed regions gave a high recognition performance for scans under neutral expressions (minor deformations), the reported variation modeling approaches have shown higher recognition accuracies for faces with neutral or nonneutral expressions. The thesis also demonstrates that low level multimodal fusion in conjunction with variation modeling gives a higher performance than unimodal recognition and higher level fusion. Another contribution of this thesis is a novel approach for learning and morphing 3D expression deformations of 3D facial scans to those of target scans. This neutralizes the effects of expression variations among matched scans. In an extension of this approach, unseen facial scans under any facial expression were decomposed into estimates of neutral 3D faces and deformation residues. This is a very challenging problem due to the lack of the target scan. The estimated neutral faces and the deformations residues were used for face recognition and expression classification, respectively. The thesis also presents a novel approach for illumination normalization of the facial texture in textured scans...

Face Detection and Modeling for Recognition

Face Detection and Modeling for Recognition
Author: Rein-Lien Hsu
Publisher:
Total Pages: 400
Release: 2002
Genre: Biometry
ISBN:

Download Face Detection and Modeling for Recognition Book in PDF, Epub and Kindle

Face recognition has received substantial attention from researchers in biometrics, computer vision, pattern recognition, and cognitive psychology communities because of the increased attention being devoted to security, man-machine communication, content-based image retrieval, and image/video coding. We have proposed two automated recognition paradigms to advance face recognition technology. Three major tasks involved in face recognition systems are: (i) face detection, (ii) face modeling, and (iii) face matching. We have developed a face detection algorithm for color images in the presence of various lighting conditions as well as complex backgrounds. Our detection method first corrects the color bias by a lighting compensation technique that automatically estimates the parameters of reference white for color correction. We overcame the difficulty of detecting the low-luma and high-luma skin tones by applying a nonlinear transformation to the Y CbCr color space. Our method generates face candidates based on the spatial arrangement of detected skin patches. We constructed eye, mouth, and face boundary maps to verify each face candidate. Experimental results demonstrate successful detection of faces with different sizes, color, position, scale, orientation, 3D pose, and expression in several photo collections. 3D human face models augment the appearance-based face recognition approaches to assist face recognition under the illumination and head pose variations. For the two proposed recognition paradigms, we have designed two methods for modeling human faces based on (i) a generic 3D face model and an individual's facial measurements of shape and texture captured in the frontal view, and (ii) alignment of a semantic face graph, derived from a generic 3D face model, onto a frontal face image.

Face Biometrics for Personal Identification

Face Biometrics for Personal Identification
Author: Besma Abidi
Publisher: Springer Science & Business Media
Total Pages: 276
Release: 2007-04-08
Genre: Computers
ISBN: 3540493468

Download Face Biometrics for Personal Identification Book in PDF, Epub and Kindle

This book provides ample coverage of theoretical and experimental state-of-the-art work as well as new trends and directions in the biometrics field. It offers students and software engineers a thorough understanding of how some core low-level building blocks of a multi-biometric system are implemented. While this book covers a range of biometric traits, its main emphasis is placed on multi-sensory and multi-modal face biometrics algorithms and systems.

Machine Learning Based 3D Face Biometrics with Local Low-level Geometrical Features

Machine Learning Based 3D Face Biometrics with Local Low-level Geometrical Features
Author: Yinjie Lei
Publisher:
Total Pages: 128
Release: 2013
Genre:
ISBN:

Download Machine Learning Based 3D Face Biometrics with Local Low-level Geometrical Features Book in PDF, Epub and Kindle

[Truncated abstract] Biometrics has been an active research area due to its enormous potential applications in video surveillance, human-machine interaction and access control systems. Among the biometric traits, the human face is the most publicly accepted biometric because of its non-intrusiveness and easy data acquisition. Most of the work on face recognition has been accomplished using 2D data. 2D face recognition systems are not robust to variations in pose, illumination conditions and facial expressions. With the rapid advancements in the development of data capturing technologies (e.g. Minolta Vivid and Microsoft Kinect), the acquisition of 3D data is becoming a more feasible task. 3D data processing has the potential to overcome the limitations and drawbacks faced by 2D facial data. Most of the existing 3D face recognition systems rely on the surface registration of the gallery and probe faces and/or on complex feature matching techniques. These methods are sensitive to facial expression and computationally expensive and are not suitable for real-world applications. In this thesis, we present novel algorithms based on low-level geometrical signatures which can be extracted at a low computational cost. To address the issue of facial expression variations, we adopt various machine learning techniques. This thesis is organized as a set of papers published in journals or currently under review. Three different local geometric feature based approaches have been proposed and their efficiency has been demonstrated through extensive experimental evaluations on the largest publicly available 3D face datasets. First, a fast and fully automatic approach based on four kinds of low-level geometrical features collected from the semi-rigid facial regions was devised and used to represent 3D faces. As a result, the effects of the deformed facial regions are avoided. The extracted features revealed to be efficient in computation and robust in the presence of facial expressions. A region-based histogram descriptor computed from these features was used as a single feature vector for a 3D face. The resulting feature vectors are independent of the coordinate system and hence can be tolerant to minor pose variations. A Support Vector Machine (SVM) was then trained as a classifier based on the proposed histogram descriptors to recognize any test face. In order to combine the contributions of the two semi-rigid facial regions (eyesforehead and nose), both feature-level and score-level fusion schemes are tested and compared. The experimental results demonstrate that feature-level fusion achieves a higher performance compared to score-level fusion. Second, in order to further increase the computational efficiency and robustness, a computationally efficient 3D face recognition approach is presented based on a novel facial signature called Angular Radial Signature (ARS). This approach extracts a set of ARS features from the semi-rigid regions of a 3D face. It was demonstrated that the extraction of these signatures is highly efficient (low computational cost). The Kernel Principal Component Analysis (KPCA) is subsequently used to extract the mid-level features from the ARSs to achieve a greater discriminative power and to deal with the linearly inseparable classification problem...

3D Face Modeling, Analysis and Recognition

3D Face Modeling, Analysis and Recognition
Author: Mohamed Daoudi
Publisher: John Wiley & Sons
Total Pages: 219
Release: 2013-06-11
Genre: Technology & Engineering
ISBN: 1118592638

Download 3D Face Modeling, Analysis and Recognition Book in PDF, Epub and Kindle

3D Face Modeling, Analysis and Recognition presents methodologies for analyzing shapes of facial surfaces, develops computational tools for analyzing 3D face data, and illustrates them using state-of-the-art applications. The methodologies chosen are based on efficient representations, metrics, comparisons, and classifications of features that are especially relevant in the context of 3D measurements of human faces. These frameworks have a long-term utility in face analysis, taking into account the anticipated improvements in data collection, data storage, processing speeds, and application scenarios expected as the discipline develops further. The book covers face acquisition through 3D scanners and 3D face pre-processing, before examining the three main approaches for 3D facial surface analysis and recognition: facial curves; facial surface features; and 3D morphable models. Whilst the focus of these chapters is fundamentals and methodologies, the algorithms provided are tested on facial biometric data, thereby continually showing how the methods can be applied. Key features: • Explores the underlying mathematics and will apply these mathematical techniques to 3D face analysis and recognition • Provides coverage of a wide range of applications including biometrics, forensic applications, facial expression analysis, and model fitting to 2D images • Contains numerous exercises and algorithms throughout the book

Robust Face Recognition Based on Three Dimensional Data

Robust Face Recognition Based on Three Dimensional Data
Author: Di Huang
Publisher:
Total Pages: 161
Release: 2011
Genre:
ISBN:

Download Robust Face Recognition Based on Three Dimensional Data Book in PDF, Epub and Kindle

The face is one of the best biometrics for person identification and verification related applications, because it is natural, non-intrusive, and socially weIl accepted. Unfortunately, an human faces are similar to each other and hence offer low distinctiveness as compared with other biometrics, e.g., fingerprints and irises. Furthermore, when employing facial texture images, intra-class variations due to factors as diverse as illumination and pose changes are usually greater than inter-class ones, making 2D face recognition far from reliable in the real condition. Recently, 3D face data have been extensively investigated by the research community to deal with the unsolved issues in 2D face recognition, Le., illumination and pose changes. This Ph.D thesis is dedicated to robust face recognition based on three dimensional data, including only 3D shape based face recognition, textured 3D face recognition as well as asymmetric 3D-2D face recognition. In only 3D shape-based face recognition, since 3D face data, such as facial pointclouds and facial scans, are theoretically insensitive to lighting variations and generally allow easy pose correction using an ICP-based registration step, the key problem mainly lies in how to represent 3D facial surfaces accurately and achieve matching that is robust to facial expression changes. In this thesis, we design an effective and efficient approach in only 3D shape based face recognition. For facial description, we propose a novel geometric representation based on extended Local Binary Pattern (eLBP) depth maps, and it can comprehensively describe local geometry changes of 3D facial surfaces; while a 81FT -based local matching process further improved by facial component and configuration constraints is proposed to associate keypoints between corresponding facial representations of different facial scans belonging to the same subject. Evaluated on the FRGC v2.0 and Gavab databases, the proposed approach proves its effectiveness. Furthermore, due tq the use of local matching, it does not require registration for nearly frontal facial scans and only needs a coarse alignment for the ones with severe pose variations, in contrast to most of the related tasks that are based on a time-consuming fine registration step. Considering that most of the current 3D imaging systems deliver 3D face models along with their aligned texture counterpart, a major trend in the literature is to adopt both the 3D shape and 2D texture based modalities, arguing that the joint use of both clues can generally provides more accurate and robust performance than utilizing only either of the single modality. Two important factors in this issue are facial representation on both types of data as well as result fusion. In this thesis, we propose a biological vision-based facial representation, named Oriented Gradient Maps (OGMs), which can be applied to both facial range and texture images. The OGMs simulate the response of complex neurons to gradient information within a given neighborhood and have properties of being highly distinctive and robust to affine illumination and geometric transformations. The previously proposed matching process is then adopted to calculate similarity measurements between probe and gallery faces. Because the biological vision-based facial representation produces an OGM for each quantized orientation of facial range and texture images, we finally use a score level fusion strategy that optimizes weights by a genetic algorithm in a learning pro cess. The experimental results achieved on the FRGC v2.0 and 3DTEC datasets display the effectiveness of the proposed biological vision-based facial description and the optimized weighted sum fusion. [...].

Human Recognition at a Distance in Video

Human Recognition at a Distance in Video
Author: Bir Bhanu
Publisher: Springer Science & Business Media
Total Pages: 268
Release: 2010-11-05
Genre: Computers
ISBN: 0857291246

Download Human Recognition at a Distance in Video Book in PDF, Epub and Kindle

Most biometric systems employed for human recognition require physical contact with, or close proximity to, a cooperative subject. Far more challenging is the ability to reliably recognize individuals at a distance, when viewed from an arbitrary angle under real-world environmental conditions. Gait and face data are the two biometrics that can be most easily captured from a distance using a video camera. This comprehensive and logically organized text/reference addresses the fundamental problems associated with gait and face-based human recognition, from color and infrared video data that are acquired from a distance. It examines both model-free and model-based approaches to gait-based human recognition, including newly developed techniques where the both the model and the data (obtained from multiple cameras) are in 3D. In addition, the work considers new video-based techniques for face profile recognition, and for the super-resolution of facial imagery obtained at different angles. Finally, the book investigates integrated systems that detect and fuse both gait and face biometrics from video data. Topics and features: discusses a framework for human gait analysis based on Gait Energy Image, a spatio-temporal gait representation; evaluates the discriminating power of model-based gait features using Bayesian statistical analysis; examines methods for human recognition using 3D gait biometrics, and for moving-human detection using both color and thermal image sequences; describes approaches for the integration face profile and gait biometrics, and for super-resolution of frontal and side-view face images; introduces an objective non-reference quality evaluation algorithm for super-resolved images; presents performance comparisons between different biometrics and different fusion methods for integrating gait and super-resolved face from video. This unique and authoritative text is an invaluable resource for researchers and graduate students of computer vision, pattern recognition and biometrics. The book will also be of great interest to professional engineers of biometric systems.

Guide to Biometric Reference Systems and Performance Evaluation

Guide to Biometric Reference Systems and Performance Evaluation
Author: Dijana Petrovska-Delacrétaz
Publisher: Springer Science & Business Media
Total Pages: 414
Release: 2009-04-05
Genre: Computers
ISBN: 1848002920

Download Guide to Biometric Reference Systems and Performance Evaluation Book in PDF, Epub and Kindle

Biometrics has moved from using fingerprints to using many methods of assessing human physical and behavioral traits. This guide introduces a new performance evaluation framework designed to offer full coverage of performance evaluation of biometric systems.

Social Signal Processing

Social Signal Processing
Author: Judee K. Burgoon
Publisher: Cambridge University Press
Total Pages: 441
Release: 2017-05-08
Genre: Computers
ISBN: 1108124585

Download Social Signal Processing Book in PDF, Epub and Kindle

Social Signal Processing is the first book to cover all aspects of the modeling, automated detection, analysis, and synthesis of nonverbal behavior in human-human and human-machine interactions. Authoritative surveys address conceptual foundations, machine analysis and synthesis of social signal processing, and applications. Foundational topics include affect perception and interpersonal coordination in communication; later chapters cover technologies for automatic detection and understanding such as computational paralinguistics and facial expression analysis and for the generation of artificial social signals such as social robots and artificial agents. The final section covers a broad spectrum of applications based on social signal processing in healthcare, deception detection, and digital cities, including detection of developmental diseases and analysis of small groups. Each chapter offers a basic introduction to its topic, accessible to students and other newcomers, and then outlines challenges and future perspectives for the benefit of experienced researchers and practitioners in the field.

Handbook of Biometric Anti-Spoofing

Handbook of Biometric Anti-Spoofing
Author: Sébastien Marcel
Publisher: Springer
Total Pages: 522
Release: 2019-01-01
Genre: Computers
ISBN: 3319926276

Download Handbook of Biometric Anti-Spoofing Book in PDF, Epub and Kindle

This authoritative and comprehensive handbook is the definitive work on the current state of the art of Biometric Presentation Attack Detection (PAD) – also known as Biometric Anti-Spoofing. Building on the success of the previous, pioneering edition, this thoroughly updated second edition has been considerably expanded to provide even greater coverage of PAD methods, spanning biometrics systems based on face, fingerprint, iris, voice, vein, and signature recognition. New material is also included on major PAD competitions, important databases for research, and on the impact of recent international legislation. Valuable insights are supplied by a selection of leading experts in the field, complete with results from reproducible research, supported by source code and further information available at an associated website. Topics and features: reviews the latest developments in PAD for fingerprint biometrics, covering optical coherence tomography (OCT) technology, and issues of interoperability; examines methods for PAD in iris recognition systems, and the application of stimulated pupillary light reflex for this purpose; discusses advancements in PAD methods for face recognition-based biometrics, such as research on 3D facial masks and remote photoplethysmography (rPPG); presents a survey of PAD for automatic speaker recognition (ASV), including the use of convolutional neural networks (CNNs), and an overview of relevant databases; describes the results yielded by key competitions on fingerprint liveness detection, iris liveness detection, and software-based face anti-spoofing; provides analyses of PAD in fingervein recognition, online handwritten signature verification, and in biometric technologies on mobile devicesincludes coverage of international standards, the E.U. PSDII and GDPR directives, and on different perspectives on presentation attack evaluation. This text/reference is essential reading for anyone involved in biometric identity verification, be they students, researchers, practitioners, engineers, or technology consultants. Those new to the field will also benefit from a number of introductory chapters, outlining the basics for the most important biometrics.