1 / 40

Automatic 3D Face Recognition System

Automatic 3D Face Recognition System. Biometric Authentication. 695410042 邱彥霖 491410044 龔士傑. Outline. Introduction Nose Tip extraction Pose Correction Face Segmentation Recognition. Introduction. Nose Tip extraction. Reference.

fionan
Download Presentation

Automatic 3D Face Recognition System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Automatic 3D Face RecognitionSystem Biometric Authentication 695410042 邱彥霖 491410044 龔士傑

  2. Outline • Introduction • Nose Tip extraction • Pose Correction • Face Segmentation • Recognition

  3. Introduction

  4. Nose Tip extraction

  5. Reference [1] X. Lu and A. K. Jain. "Multimodal facial feature extraction for automatic 3D face recognition," Technical Report MSU-CSE-05-22, Department of Computer Science, Michigan State University, East Lansing, Michigan, August 2005. [2] X. Lu and Anil K. Jain, "Automatic Feature Extraction for Multiview 3D Face Recognition," Proc. 7th IEEE International Conference on Automatic Face and Gesture Recognition (FG2006), pp. 585-590, Southampton, UK, Apr. 2006. [3] M.L. Koudelka, M.W. Koch, T.D. Russ, A prescreener for 3D face recognition using radial symmetry and the Hausdorff fraction, in: IEEE Workshop on Face Recognition Grand Challenge Experiments, June 2005. [4] A. S. Mian, M. Bennamoun and R. A. Owens, “Automatic 3D Face Detection, Normalization and Recognition”, 3DPVT, 2006.

  6. Face Segmentation [1] X. Lu and A. K. Jain. "Multimodal facial feature extraction for automatic 3D face recognition.”

  7. Nose Tip Extraction : Frontal scan [1] X. Lu and A. K. Jain. "Multimodal facial feature extraction for automatic 3D face recognition.”

  8. Nose Tip Extraction : Frontal scan [1] X. Lu and A. K. Jain. "Multimodal facial feature extraction for automatic 3D face recognition.”

  9. Nose Tip Extraction : Pose change • For a frontal facial scan, nose tip usually has the largest z value. • But, in the presence of large pose changes, this heuristic does not hold. [2] X. Lu and Anil K. Jain, "Automatic Feature Extraction for Multiview 3D Face Recognition."

  10. Nose Tip and Pose Estimation Pose quantization • The yaw angle change ranges from -90 degrees (full right profile) to 90 degrees (full left profile) in the X-Z plane. [2] X. Lu and Anil K. Jain, "Automatic Feature Extraction for Multiview 3D Face Recognition."

  11. Nose Tip and Pose Estimation Directional maximum [2] X. Lu and Anil K. Jain, "Automatic Feature Extraction for Multiview 3D Face Recognition."

  12. Nose Tip and Pose Estimation Pose correction [2] X. Lu and Anil K. Jain, "Automatic Feature Extraction for Multiview 3D Face Recognition."

  13. Nose Tip and Pose Estimation Nose profile extraction [2] X. Lu and Anil K. Jain, "Automatic Feature Extraction for Multiview 3D Face Recognition."

  14. Nose Tip Extraction : Pose change • Nose Tip Extraction : • Radial Symmetry Map • Gradient and Zero-Crossing Map [3] M.L. Koudelka, M.W. Koch, T.D. Russ, A prescreener for 3D face recognition using radial symmetry and the Hausdorff fraction.

  15. Radial Symmetry Map • First, the gradient of the image, g is computed at each pixel p. [3] M.L. Koudelka, M.W. Koch, T.D. Russ, A prescreener for 3D face recognition using radial symmetry and the Hausdorff fraction.

  16. Radial Symmetry Map • For each pair of affected pixels, the corresponding point P+ve in the orientation projection image is incremented by 1, respectively, while the point corresponding to P-ve isdecremented by 1. [3] M.L. Koudelka, M.W. Koch, T.D. Russ, A prescreener for 3D face recognition using radial symmetry and the Hausdorff fraction.

  17. Gradient and Zero-Crossing Map • The shape of the face is another effective indicator of key facial features. [3] M.L. Koudelka, M.W. Koch, T.D. Russ, A prescreener for 3D face recognition using radial symmetry and the Hausdorff fraction.

  18. Nose Tip Extraction • Each 3D face is horizontally sliced at multiple steps dv. • The nose tip is detected using a coarse to fine approach. • Circles centered at horizontal intervals dh on the slice. • The point which has the maximum altitude is considered to be a potential nose tip and assigned a confidence value equal to the altitude. [4] A. S. Mian, M. Bennamoun and R. A. Owens, “Automatic 3D Face Detection, Normalization and Recognition.”

  19. Face Detection • A sphere of radius r (80 mm) centered at the nose tip is then used to crop the 3D face and its corresponding registered 2D face. [4] A. S. Mian, M. Bennamoun and R. A. Owens, “Automatic 3D Face Detection, Normalization and Recognition.”

  20. Pose Correction

  21. Reference [1] A. S. Mian, M. Bennamoun and R. A. Owens, “Automatic 3D Face Detection, Normalization and Recognition”, 3DPVT, 2006.

  22. Pose Correction • Pose is corrected using the Hotelling transform. • To calculate the mean vector and covariance matrix. • The matrix of eigenvectors V of the covariance matrix C [1] A. S. Mian, M. Bennamoun and R. A. Owens, “Automatic 3D Face Detection, Normalization and Recognition.”

  23. Pose Correction • V is also a rotation matrix that aligns the point cloud P on its principal axes. [1] A. S. Mian, M. Bennamoun and R. A. Owens, “Automatic 3D Face Detection, Normalization and Recognition.”

  24. Face Normalization [1] A. S. Mian, M. Bennamoun and R. A. Owens, “Automatic 3D Face Detection, Normalization and Recognition.”

  25. Face Segmentation

  26. Reference [1] Ajmal S. Mian, M. Bennamoun and R. Owens, "An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition", to appear in IEEE Transactions in Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2007. [2] K.-C. Wong, W.-Y. Lin, Y. H. Hu, N. Boston, and X. Zhang, "Optimal Linear Combination of Facial Regions for Improving Identification Performance", IEEE Trans. Systems, Man, and CyberneticsPart B: Cybernetics, Accepted, 2007.

  27. Face Segmentation and Recognition • Robustness to facial expressions by automatically segmenting the face into expression sensitive and insensitive regions. • To measure the variance in the depth of the corresponding pixels (neutral and non-neutral expression). [1] Ajmal S. Mian, M. Bennamoun and R. Owens, "An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition."

  28. Face Segmentation and Recognition • The features were automatically segmented by detecting the inflection points around the nose tip. [1] Ajmal S. Mian, M. Bennamoun and R. Owens, "An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition."

  29. Results and Analysis [1] Ajmal S. Mian, M. Bennamoun and R. Owens, "An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition."

  30. Multiple Region Face Recognition [2] K.-C. Wong, W.-Y. Lin, Y. H. Hu, N. Boston, and X. Zhang, "Optimal Linear Combination of Facial Regions for Improving Identification Performance."

  31. Similarity ScoreROC [2] K.-C. Wong, W.-Y. Lin, Y. H. Hu, N. Boston, and X. Zhang, "Optimal Linear Combination of Facial Regions for Improving Identification Performance."

  32. Results and Analysis [2] K.-C. Wong, W.-Y. Lin, Y. H. Hu, N. Boston, and X. Zhang, "Optimal Linear Combination of Facial Regions for Improving Identification Performance."

  33. Recognition

  34. Reference [1] M. Worring and A. W. M. Smeulders, " Digital curvature estimation ", CVGIP: Image Understanding, 58(3):366–382, 1993. [2] N. Gelfand, N. J. Mitra, L. J. Guibas, and H. Pottmann, "Robust global registration", In Proc. Symp. Geom. Processing, pages 197–206, 2005. [3] Robust Curvature Estimation Through Line Integrals.

  35. Gaussian Convolution [1] M. Worring and A. W. M. Smeulders, " Digital curvature estimation ."

  36. Results and Analysis [1] M. Worring and A. W. M. Smeulders, " Digital curvature estimation ."

  37. Area Integrals [2] N. Gelfand, N. J. Mitra, L. J. Guibas, and H. Pottmann, "Robust global registration".

  38. Results and Analysis [2] N. Gelfand, N. J. Mitra, L. J. Guibas, and H. Pottmann, "Robust global registration".

  39. Line Integrals [3] Robust Curvature Estimation Through Line Integrals.

  40. Results and Analysis [3] Robust Curvature Estimation Through Line Integrals.

More Related