Skip to main content
SpringerLink
Log in

Reg3DFacePtCd: Registration of 3D Point Clouds Using a Common Set of Landmarks for Alignment of Human Face Images

  • Technical Contribution
  • Published:
KI - Künstliche Intelligenz Aims and scope Submit manuscript

Abstract

The present work proposes a new method Reg3DFacePtCd for registration of point clouds. The key contribution of the present method is that an unknown face in 3D point cloud form is given to the system and is registered to the already existing known 3D face point clouds using a fast 3D face registration method. The novelty of the present technique is that at first the alignment and registration parameters are found out by initially registering eight key points of the unknown source model to that of the known model. Next, the rest of the point clouds of the unknown model are registered to that of the known model using the same parameters found as above. The main method used for alignment is iterative closest point (ICP) using point-based technique followed by registration in the least squares sense. Mainly there are two significant contributions. Firstly, we have developed a new mathematical model facial landmark point based model across poses to obtain the target or the known model to which all the unknown models will be registered. Secondly, a novel way to accelerate point cloud matching by reducing the number of points has been proposed. Using a small number of points necessarily would speed up the registration process but may inculcate errors. So, to determine the registration quality of the fundamental eight key points on which the entire registration process is based, a new robust metric namely ICV (ICP certainty vector) consisting of several key components have been used. Finally, we have addressed several important face registration issues like pre-processing, convergence and quality of registration of the entire facial point cloud based on the eight key points. Extensive experimentation on Frav3D, GavabDB, and the Bosphorus databases on a high-performance computing environment show the novelty and robustness of the method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Liu Y, Zhou W, Yang Z, Deng J, Liu L (2014) Globally consistent rigid registration. Graph Models 76(5):542–553

    Article  Google Scholar 

  2. Kakadiaris IA, Passalis G, Toderici G, Murtuza MN, Lu Y, Karampatziakis N, Theoharis T (2007) Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans Pattern Anal Mach Intell 29(4):640–649

    Article  Google Scholar 

  3. Papatheodorou T, Rueckert D (2005). Evaluation of 3D face recognition using registration and pca. In: 5th international conference on audio and video-based biometric person authentication (AVBPA 2005), pp 997–1009

    Google Scholar 

  4. Salah AA, Alyuz N, Akarun L (2008) Registration of three-dimensional face scans with average face models. J Electron Imaging 17(1):1–14

    Google Scholar 

  5. Liu X (2009) Discriminative face alignment. IEEE Trans Pattern Anal Mach Intell 31(11):1941–1954

    Article  Google Scholar 

  6. Yang F, Huang J, Metaxas D (2011) Sparse shape registration for occluded facial feature localization. In: Face and gesture. IEEE, pp 272–277

  7. Boyi J (2018) Deep face feature for face alignment and reconstruction. arXiv preprint. arXiv:1708.02721

  8. Qu C, Monari E, Schuchert T, Beyerer J (2015) Adaptive contour fitting for pose-invariant 3D face shape reconstruction. In: Xie X, Jones MW, Tam GKL (eds) Proceedings of the British machine vision conference (BMVC). BMVA Press, pp 87.1–87.12

  9. Perakis P (2010) 3D facial landmark detection & face registration a 3D facial landmark model & 3D local shape descriptors approach. CGL Technical Report, No. TP-2010-01

  10. Passalis G, Perakis P, Theoharis T, Kakadiaris IA (2011) Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Trans Pattern Anal Mach Intell 33(10):1938–1951

    Article  Google Scholar 

  11. Nair P, Cavallaro A (2008) Registration and retrieval of 3D faces using a point distribution model. In: IEEE international conference on shape modeling and applications

  12. Amberg B, Knothe R, Vetter T (2008) Expression invariant 3D face recognition with a morphable model. In: IEEE international conference on automatic face & gesture recognition

  13. Wang X, Ruan Q, Jin Y, An G (2014) Three-dimensional face recognition under expression variation. EURASIP J Image Video Process 2014(1):51

    Article  Google Scholar 

  14. Stormer A, Rigoll G (2008) A multi-step alignment scheme for face recognition in range images. In: 15th IEEE international conference on image processing

  15. Lee B, Lee DD (2016) Learning anisotropic ICP (LA-ICP) for robust and efficient 3D registration. In: IEEE international conference on robotics and automation (ICRA)

  16. Ping Y, Bowyer KW (2007) A fast algorithm for ICP-based 3D shape biometrics. Comput Vis Image Underst 107(3):195–202

    Article  Google Scholar 

  17. Lu X, Colbry D, Jain AK (2004) Three-dimensional model based face recognition. In: Proceedings of ICPR

  18. Lu X, Jain AK, Colbry D (2006) Matching 2.5D Face Scans to 3D Models. IEEE Trans Pattern Anal Mach Intell 28(1):31–43

    Article  Google Scholar 

  19. Hermans J, Smeets D, Vandermeulen D, Suetens P (2011) Robust point set registration using EM-ICP with information-theoretically optimal outlier handling. In: CVPR. IEEE, pp 2465–2472

  20. Pavlov AL, Ovchinnikov GW, Derbyshev DY, Tsetserukou D, Oseledets IV (2018) AA-ICP: iterative closest point with anderson acceleration. In: IEEE international conference on robotics and automation, ICRA, pp 1–6

  21. http://bosphorus.ee.boun.edu.tr/Content.aspx. Accessed 1 June 2018

  22. Gilani SZ, Shafait F, Mian A (2013) Biologically significant facial landmarks: how significant are they for gender classification? In: International conference on digital image computing: techniques and applications (DICTA), Hobart, TAS, pp 1–8

  23. Mora H, Mora PJM, Garcia-Garcia A, Martinez Gonzalez P (2016) Computational analysis of distance operators for the iterative closest point algorithm. PLoS One 11(10):1–19

    Article  Google Scholar 

  24. Liu Y, Martin RR, Chen L, Ren X, Li L (2016 first online) Rigid registration. In: Ikeuchi K (ed) Computer vision. Springer, Boston, MA

  25. Besl PJ, McKay ND (1992) Method for registration of 3-D shapes. In: Sensor fusion IV: control paradigms and data structures, vol 1611. International society for optics and photonics

  26. Kaiser M, Stormer A, Arsic D, Rigoll G (2009) Non-rigid registration of 3D facial surfaces with robust outlier detection. In: Workshop on applications of computer vision

  27. Bouaziz S, Pauly M (2013) Dynamic 2D/3D registration for the kinect. SIGGRPAH 2013 Course Note

  28. Robert Li H, Summer W, Pauly M (2008) Global correspondence optimization for non-rigid registration of depth scans. In: Eurographics symposium on geometry processing

  29. Naveen S, Rugmini KP, Moni RS (2016) 3D face reconstruction by pose correction, patch cloning and texture wrapping. In: International conference on communication systems and networks, pp 112–116

  30. Naveen S, Moni RS (2015) A robust novel method for face recognition from 2D depth images using DWT and DCT fusion. Proc Comput Sci 46:1518–1528

    Article  Google Scholar 

  31. Conde C, Serrano A, Cabello E (2006) Multimodal 2D, 2.5 D and 3D face verification. In: IEEE international conference on image processing, pp 2061–2064

  32. Nair P, Cavallaro A (2009) 3D face detection, landmark localization, and registration using a point distribution model. IEEE Trans Multimed 11(4):611–623

    Article  Google Scholar 

  33. Mahoora MH, Mottalebb MA (2009) Face recognition based on 3D ridge images obtained from range data. In: Pattern recognition, pp 445–451

    Article  Google Scholar 

  34. Maes C, Fabry T, Keustermans J, Smeets D, Suetens P, Vandermeulen D (2010) Feature detection on 3D face surfaces for pose normalisation and recognition. In: 4th IEEE international conference on biometrics: theory applications and systems, pp 1–6

  35. Bouaziz S, Tagliasachhi A, Pauly M (2013) Sparse iterative closest point. In: Eurographics symposium on geometry processing

  36. Sagawa R, Akasaka K, Yagi Y, Hammer H, Gool LV (2009) Elastic convolved ICP for the registration of deformable objects. In: 12th IEEE international conference on computer vision workshops, Japan

  37. Hu Y, Liu W (2013) 3D face recognition based on MPU implicits. IEICE Trans Inf Syst 96(9):2174–2176

    Article  Google Scholar 

  38. Bazik M, Crispell D (2017) Robust registration and geometry estimation from unstructured facial scans. arXiv preprint arXiv:1708.05340

  39. Li F, Stoddart D, Hitchens C (2017) Method to automatically register scattered point clouds based on principal pose estimation. Opt Eng 56(4):1–10

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, RCC Institute of Information Technology, Beliaghata, Calcutta, India

    Parama Bagchi

  2. Department of Computer Science and Engineering, Jadavpur University, Calcutta, India

    Debotosh Bhattacharjee & Mita Nasipuri

Authors
  1. Parama Bagchi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Debotosh Bhattacharjee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mita Nasipuri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Parama Bagchi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bagchi, P., Bhattacharjee, D. & Nasipuri, M. Reg3DFacePtCd: Registration of 3D Point Clouds Using a Common Set of Landmarks for Alignment of Human Face Images. Künstl Intell 33, 369–387 (2019). https://doi.org/10.1007/s13218-019-00593-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13218-019-00593-2

Keywords

Search

Navigation